00000001:02000400:3.0F:1788890824.714924:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788890833.502582:0:3157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788890834.356290:0:3219:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1307 MB/s 00000001:01000000:1.0:1788890834.606499:0:3219:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1611 MB/s 00000001:01000000:1.0:1788890834.856246:0:3219:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10827 MB/s 00000020:02000000:3.0:1788890835.136338:0:3248:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_ga91bf53 00000400:02000000:0.0F:1788890835.445607:0:3263:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.118@tcp [8/256/0/180] 00008000:02000000:3.0:1788890837.676234:0:3413:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0F:1788890854.075292:0:5215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788890857.533992:0:5795:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788890857.533995:0:5795:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788890857.534067:0:5795:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c69bb2e5 00000080:02000400:1.0:1788890857.534074:0:5795:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788890857.537382:0:5795:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788890857.537389:0:5795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788890857.537412:0:5795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b389efff) 00000020:00000080:1.0:1788890857.537424:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788890857.544849:0:5795:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788890857.545103:0:5795:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788890857.555732:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788890857.555772:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788890857.555794:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788890857.555845:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788890857.555887:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788890857.556233:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788890857.556240:0:5795:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788890857.556252:0:5795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3eb06 00000020:01000004:1.0:1788890857.556259:0:5795:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788890857.556263:0:5795:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788890857.556267:0:5795:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c69bb2e5 from MGS 00000020:01000004:1.0:1788890857.556271:0:5795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788890857.556280:0:5795:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001bb9d493) 00000020:00000080:1.0:1788890857.556289:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788890857.556340:0:5795:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c69bb2e5 from MGS, refs=2 00080000:01000000:1.0:1788890857.556344:0:5795:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788890857.556348:0:5795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3eb14 00000100:00100000:1.0:1788890857.556439:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788890857.556563:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788890857.556569:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788890857.556881:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788890857.556886:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788890857.557424:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788890857.557512:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788890857.557515:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788890857.557824:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788890857.557829:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788890857.558031:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788890857.558036:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788890857.558406:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890857.558411:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890857.558413:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890857.558575:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890857.558577:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890857.558579:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890857.558888:0:5795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788890857.561309:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788890857.808296:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 7023 MB/s 00000001:01000000:0.0:1788890858.058270:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 8187 MB/s 00000001:01000000:0.0:1788890858.308785:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1495 MB/s 00000001:01000000:0.0:1788890858.558352:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1891 MB/s 00080000:10000000:0.0:1788890858.561807:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788890858.568768:0:5795:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788890858.568784:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788890858.568787:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788890858.569284:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788890858.569308:0:5795:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788890858.569344:0:5795:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788890858.569490:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788890858.569515:0:5795:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788890858.569889:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890858.570071:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788890858.570077:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788890858.570602:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788890858.570609:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788890858.570843:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788890858.570851:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788890858.571209:0:5811:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788890858.571257:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788890858.571276:0:5795:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.118@tcp' 00000020:01000004:3.0:1788890858.571278:0:5795:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788890858.571322:0:5795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.118@tcp (typ=mgc) 00000020:00000080:3.0:1788890858.571344:0:5795:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.118@tcp (000000008bb01aa3) 00000020:00000080:3.0:1788890858.571360:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788890858.571473:0:5795:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000248bade6@MGC192.168.204.118@tcp: add connection 192.168.204.118@tcp at head 00010000:00010000:3.0:1788890858.571695:0:5795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.118@tcp-0 is initialized 00000040:01000000:3.0:1788890858.571702:0:5795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.118@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788890858.571947:0:5812:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788890858.571972:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.118@tcp (uuid 68b804f9-71ae-42dc-a11e-677332e27dfa) 00000020:00000080:3.0:1788890858.571987:0:5795:0:(genops.c:1385:class_connect()) connect: client 68b804f9-71ae-42dc-a11e-677332e27dfa, cookie 0x9161b78f8ec3eb22 00000100:00080000:3.0:1788890858.571995:0:5795:0:(import.c:510:import_select_connection()) MGC192.168.204.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788890858.572001:0:5795:0:(import.c:624:import_select_connection()) MGC192.168.204.118@tcp: import 00000000248bade6 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788890858.572036:0:5795:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bfeb56a3 x1875787996201088/t0(0) o250->MGC192.168.204.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788890858.572057:0:5795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 68b804f9-71ae-42dc-a11e-677332e27dfa->MGS 00000020:01000004:3.0:1788890858.572076:0:5795:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788890858.572099:0:5795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788890858.572108:0:5795:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000063d48fdb) 00000020:00000080:3.0:1788890858.572120:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788890858.574401:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfeb56a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68b804f9-71ae-42dc-a11e-677332e27dfa:3278:1875787996201088:0@lo:250: 00000100:00100000:1.0:1788890858.574461:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890858.574527:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996201088 00000100:00100000:1.0:1788890858.574532:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996201088 00000100:00100000:1.0:1788890858.574559:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788890858.574563:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099907e59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3278:x1875787996201088:12345-0@lo:250: 00010000:00080000:1.0:1788890858.574583:0:5807:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 68b804f9-71ae-42dc-a11e-677332e27dfa@0@lo t0 exp 0000000000000000 cur 82 last 0 00000020:00000080:1.0:1788890858.574620:0:5807:0:(genops.c:1385:class_connect()) connect: client 68b804f9-71ae-42dc-a11e-677332e27dfa, cookie 0x9161b78f8ec3eb30 00000100:00080000:1.0:1788890858.574782:0:5807:0:(import.c:65:import_set_state_nolock()) 00000000ee06c7f6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788890858.574846:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099907e59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+5:3278:x1875787996201088:12345-0@lo:250: Request processed in 269us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.574854:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788890858.574906:0:3278:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788890858.574915:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) MGC192.168.204.118@tcp: connect to target with instance 0 00000100:00080000:1.0:1788890858.574922:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) MGC192.168.204.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788890858.574927:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788890858.574930:0:3278:0:(import.c:65:import_set_state_nolock()) 00000000248bade6 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788890858.574939:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788890858.574948:0:3278:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788890858.574955:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfeb56a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68b804f9-71ae-42dc-a11e-677332e27dfa:3278:1875787996201088:0@lo:250: 00000100:00100000:3.0:1788890858.577752:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788890858.577947:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788890858.577953:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788890858.578480:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788890858.578487:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788890858.578715:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788890858.578729:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788890858.579237:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890858.579360:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788890858.579364:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788890858.579643:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788890858.579656:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788890858.599975:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890858.600136:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788890858.600141:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788890858.600706:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788890858.600712:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788890858.601050:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890858.601142:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788890858.601145:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788890858.601391:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788890858.601398:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788890858.601642:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890858.601717:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788890858.601720:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788890858.601934:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788890858.601939:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788890858.602242:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890858.602323:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788890858.602326:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788890858.602542:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788890858.602549:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00010000:00010000:2.0:1788890858.614282:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890858.615710:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788890858.615888:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788890858.615893:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788890858.616441:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788890858.616447:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788890858.617236:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788890858.617243:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788890858.617595:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788890858.617615:0:5795:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788890858.617620:0:5795:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788890858.617746:0:5795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788890858.617776:0:5795:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.118@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788890858.617781:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788890858.617783:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788890858.617784:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890858.617785:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890858.617786:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890858.617788:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890858.617789:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788890858.617790:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788890858.617791:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890858.617792:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890858.617794:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890858.617795:0:5795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788890858.617797:0:5795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788890858.617800:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788890858.617801:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788890858.617802:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890858.617803:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890858.617804:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890858.617805:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890858.617806:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788890858.617807:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788890858.617808:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890858.617813:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890858.617814:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890858.617815:0:5795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788890858.617850:0:5795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788890858.617864:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201216:0@lo:253: 00000100:00100000:3.0:1788890858.617928:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.617968:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9b96335 going to sleep for 11 seconds 00000100:00100000:2.0:1788890858.617996:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996201216 00000100:00100000:2.0:1788890858.618004:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996201216 00000100:00100000:2.0:1788890858.618067:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788890858.618075:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb939c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+5:5795:x1875787996201216:12345-0@lo:253: 20000000:01000000:2.0:1788890858.618121:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788890858.618124:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788890858.618337:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788890858.618372:0:5810:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788890858.618649:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890858.619257:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788890858.619348:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788890858.619351:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788890858.619355:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788890858.619358:0:5810:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788890858.619372:0:5810:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788890858.619480:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788890858.619680:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788890858.619692:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788890858.619738:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788890858.619788:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788890858.619828:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788890858.619930:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788890858.619944:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788890858.620003:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788890858.620021:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788890858.620057:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788890858.620065:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788890858.620105:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788890858.620156:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788890858.620205:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788890858.620213:0:5810:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788890858.620237:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788890858.620423:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788890858.620433:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788890858.620467:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788890858.620500:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788890858.620540:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788890858.620549:0:5810:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788890858.620611:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788890858.620619:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788890858.620657:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788890858.620690:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788890858.620717:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788890858.620726:0:5810:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788890858.620804:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788890858.620812:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788890858.620854:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788890858.620886:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788890858.621032:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788890858.621079:0:5810:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788890858.621086:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788890858.621366:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788890858.621504:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788890858.621519:0:5810:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.118@tcp for mdt 20000000:01000000:2.0:1788890858.621521:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.118@tcp (null) (null) (null) 00000040:00080000:2.0:1788890858.621563:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788890858.621571:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788890858.621604:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788890858.621611:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.118@tcp (null) (null) 00000040:00080000:2.0:1788890858.621656:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788890858.621666:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788890858.621698:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788890858.621732:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788890858.621786:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788890858.621789:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788890858.621794:0:5810:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788890858.621800:0:5810:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788890858.622032:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788890858.622072:0:5810:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788890858.627755:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788890858.627810:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1788890858.627901:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1788890858.627917:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788890858.627920:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788890858.627923:0:5810:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788890858.627934:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788890858.627937:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788890858.627965:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788890858.627968:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788890858.628342:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788890858.628482:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788890858.628534:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788890858.628554:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788890858.628561:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788890858.628562:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788890858.628786:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1788890858.628925:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1788890858.628964:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788890858.629028:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1788890858.629044:0:5810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788890858.629046:0:5810:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1788890858.629051:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788890858.629068:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629088:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629098:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629104:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629111:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629118:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629123:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d4e85f9 already unused, calling callback (0000000063948432) 00010000:00010000:2.0:1788890858.629127:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629133:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629146:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629152:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.629158:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d4e85f9/0x9161b78f8ec3eb37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788890858.629212:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788890858.694259:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb939c9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+5:5795:x1875787996201216:12345-0@lo:253: Request processed in 76181us (76326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.694276:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788890858.694292:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201216:0@lo:253: 10000000:01000000:3.0:1788890858.694307:0:5795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788890858.694310:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788890858.694312:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788890858.694313:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890858.694314:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788890858.694314:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890858.694315:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890858.694317:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788890858.694318:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788890858.694319:0:5795:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788890858.694320:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890858.694321:0:5795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788890858.694338:0:5795:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c69bb2e5 from lustre-MDT0000 10000000:01000000:3.0:1788890858.694354:0:5795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788890858.694356:0:5795:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788890858.694359:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9da1f024b370 10000000:01000000:3.0:1788890858.694363:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788890858.694368:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9da1f024b370 from 1 10000000:01000000:3.0:1788890858.694370:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788890858.694406:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.694425:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.694433:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890858.694450:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201344:0@lo:101: 00000100:00100000:3.0:1788890858.694495:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890858.694531:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996201344 00000100:00100000:1.0:1788890858.694539:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996201344 00000100:00100000:3.0:1788890858.694547:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c4aacd0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.694581:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890858.694591:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5f6945 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+5:5795:x1875787996201344:12345-0@lo:101: 00010000:00010000:1.0:1788890858.694605:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890858.694617:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3eb3e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.694639:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3eb3e expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.694648:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eb3e expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.694655:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000048bfdff, rc 0) 00000100:00100000:1.0:1788890858.694685:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5f6945 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+6:5795:x1875787996201344:12345-0@lo:101: Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.694691:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788890858.694710:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201344:0@lo:101: 00010000:00010000:3.0:1788890858.694722:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.694728:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890858.694758:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201472:0@lo:501: 00000100:00100000:3.0:1788890858.694774:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.694786:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c4aacd0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.694803:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996201472 00000100:00100000:1.0:1788890858.694807:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996201472 00000100:00100000:1.0:1788890858.694841:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788890858.694854:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000380848c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+6:5795:x1875787996201472:12345-0@lo:501: 00000100:00100000:1.0:1788890858.695016:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000380848c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+6:5795:x1875787996201472:12345-0@lo:501: Request processed in 165us (240us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788890858.695023:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788890858.695051:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201472:0@lo:501: 10000000:01000000:3.0:1788890858.695075:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788890858.695086:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.695094:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890858.695110:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9da1c9db0800 10000000:01000000:3.0:1788890858.695113:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788890858.695116:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9da1c9db0800 10000000:01000000:3.0:1788890858.695118:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788890858.695120:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9da1c9db0800 from 1 10000000:01000000:3.0:1788890858.695121:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788890858.695132:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 00000000f6823d51/0x9161b78f8ec3eb4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.695138:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: 00000000f6823d51/0x9161b78f8ec3eb4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.695143:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 00000000f6823d51/0x9161b78f8ec3eb4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890858.695153:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201600:0@lo:101: 00000100:00100000:3.0:1788890858.695195:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.695217:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c4aacd0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.695221:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996201600 00000100:00100000:1.0:1788890858.695226:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996201600 00000100:00100000:1.0:1788890858.695251:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788890858.695256:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e296b5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+6:5795:x1875787996201600:12345-0@lo:101: 00010000:00010000:1.0:1788890858.695262:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890858.695271:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000066563421/0x9161b78f8ec3eb53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3eb4c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.695283:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066563421/0x9161b78f8ec3eb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3eb4c expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.695290:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000066563421/0x9161b78f8ec3eb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eb4c expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.695296:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000066563421, rc 0) 00000100:00100000:1.0:1788890858.695323:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e296b5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+7:5795:x1875787996201600:12345-0@lo:101: Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.695328:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788890858.695356:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201600:0@lo:101: 00010000:00010000:3.0:1788890858.695366:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 00000000f6823d51/0x9161b78f8ec3eb4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.695372:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 00000000f6823d51/0x9161b78f8ec3eb4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890858.695380:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788890858.695388:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 00000000f6823d51/0x9161b78f8ec3eb4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.695403:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: 00000000f6823d51/0x9161b78f8ec3eb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890858.695410:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788890858.695413:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788890858.695416:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9da1c9db0800 10000000:01000000:3.0:1788890858.695418:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788890858.695421:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788890858.695422:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788890858.695433:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.695438:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.695444:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890858.695454:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201728:0@lo:101: 00000100:00100000:3.0:1788890858.695476:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.695490:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c4aacd0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.695502:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996201728 00000100:00100000:1.0:1788890858.695507:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996201728 00000100:00100000:1.0:1788890858.695529:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890858.695535:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066754232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+7:5795:x1875787996201728:12345-0@lo:101: 00010000:00010000:1.0:1788890858.695541:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890858.695547:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3eb5a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.695566:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3eb5a expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.695573:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eb5a expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.695578:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001165aa53, rc 0) 00000100:00100000:1.0:1788890858.695606:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066754232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+8:5795:x1875787996201728:12345-0@lo:101: Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.695611:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788890858.695645:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201728:0@lo:101: 00010000:00010000:3.0:1788890858.695653:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.695659:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890858.695694:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201856:0@lo:501: 00000100:00100000:3.0:1788890858.695713:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.695725:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c4aacd0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.695741:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996201856 00000100:00100000:1.0:1788890858.695745:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996201856 00000100:00100000:1.0:1788890858.695767:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788890858.695773:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8fdcee5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+8:5795:x1875787996201856:12345-0@lo:501: 00000100:00100000:1.0:1788890858.695903:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8fdcee5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:5795:x1875787996201856:12345-0@lo:501: Request processed in 129us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.695910:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788890858.695927:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201856:0@lo:501: 00000100:00100000:3.0:1788890858.695953:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201984:0@lo:503: 00000100:00100000:3.0:1788890858.695986:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.696001:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c4aacd0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.696012:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996201984 00000100:00100000:1.0:1788890858.696016:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996201984 00000100:00100000:1.0:1788890858.696037:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788890858.696043:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c491ea9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:5795:x1875787996201984:12345-0@lo:503: 00000100:00100000:1.0:1788890858.696146:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c491ea9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:5795:x1875787996201984:12345-0@lo:503: Request processed in 103us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.696153:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788890858.696164:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996201984:0@lo:503: 00000100:00100000:3.0:1788890858.696375:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:5837:1875787996202112:0@lo:502: 00000100:00100000:3.0:1788890858.696399:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.696420:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000000dd893f6 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.696421:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996202112 00000100:00100000:1.0:1788890858.696425:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996202112 00000100:00100000:1.0:1788890858.696445:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788890858.696452:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c255d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:5837:x1875787996202112:12345-0@lo:502: 00000100:00100000:1.0:1788890858.696540:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c255d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:5837:x1875787996202112:12345-0@lo:502: Request processed in 87us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.696545:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788890858.696558:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:5837:1875787996202112:0@lo:502: 00000020:01000000:3.0:1788890858.696577:0:5837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890858.696585:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890858.696586:0:5837:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788890858.696590:0:5837:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788890858.696593:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788890858.696603:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000087602087) 00000020:00000080:3.0:1788890858.696616:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788890858.696619:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788890858.696673:0:5837:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788890858.696677:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3eb6f 00000020:00000080:3.0:1788890858.696865:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788890858.696868:0:5837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890858.696870:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890858.696874:0:5837:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788890858.696876:0:5837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890858.696878:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890858.696879:0:5837:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788890858.696881:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788890858.696886:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000643772ea) 00000020:00000080:3.0:1788890858.696892:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788890858.696894:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788890858.696895:0:5837:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788890858.696897:0:5837:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788890858.696901:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788890858.696928:0:5837:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c69bb2e5 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788890858.696940:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000090f29b9c) 00000020:00000080:3.0:1788890858.696945:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788890858.696991:0:5837:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788890858.696994:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec3eb84 00000020:00000080:3.0:1788890858.697060:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788890858.697065:0:5837:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788890858.697068:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9161b78f8ec3eb8b 00080000:01000000:3.0:1788890858.697070:0:5837:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788890858.697072:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3eb92 00080000:10000000:3.0:1788890858.697386:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788890858.697515:0:5837:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788890858.699300:0:5837:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788890858.737250:0:5837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788890858.737560:0:5837:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788890858.739926:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788890858.740232:0:5837:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788890858.752026:0:5837:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fbee6c9e) 00000020:00000080:0.0:1788890858.752050:0:5837:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788890858.752199:0:5837:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788890858.752208:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3eba0 00000020:00000080:0.0:1788890858.752600:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788890858.753998:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788890858.763913:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788890858.772665:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788890858.782929:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788890858.796720:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788890858.807067:0:5837:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788890858.815940:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9161b78f8ec3eba7 00000020:00000080:2.0:1788890858.816217:0:5837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788890858.816227:0:5837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890858.816234:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890858.816236:0:5837:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788890858.816239:0:5837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890858.816244:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890858.816245:0:5837:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788890858.816250:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788890858.816286:0:5837:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788890858.816298:0:5837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890858.816301:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890858.816303:0:5837:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788890858.816305:0:5837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890858.816307:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890858.816309:0:5837:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788890858.816311:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788890858.816313:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788890858.816364:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c0b5384 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:5837:1875787996202240:0@lo:502: 00000100:00100000:2.0:1788890858.816438:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890858.816490:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996202240 00000100:00100000:2.0:1788890858.816498:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd339c83 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.816499:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996202240 00000100:00100000:1.0:1788890858.816537:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788890858.816546:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042cb6bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:5837:x1875787996202240:12345-0@lo:502: 00000100:00100000:1.0:1788890858.816794:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042cb6bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:5837:x1875787996202240:12345-0@lo:502: Request processed in 250us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.816802:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788890858.816844:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c0b5384 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:5837:1875787996202240:0@lo:502: 00000020:01000000:2.0:1788890858.816873:0:5837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890858.816877:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890858.816883:0:5837:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788890858.816886:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788890858.816944:0:5795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788890858.816960:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788890858.816972:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.816981:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890858.816987:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9da1c9db0800 from 1 10000000:01000000:0.0:1788890858.816989:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788890858.817021:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.817026:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.817032:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890858.817040:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202368:0@lo:101: 00000100:00100000:0.0:1788890858.817065:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890858.817079:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8f4b88d going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.817115:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996202368 00000100:00100000:1.0:1788890858.817121:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996202368 00000100:00100000:1.0:1788890858.817147:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788890858.817154:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000159a8162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:5795:x1875787996202368:12345-0@lo:101: 00010000:00010000:1.0:1788890858.817163:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890858.817191:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ebae expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.817207:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ebae expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.817214:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ebae expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.817221:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012a97a76, rc 0) 00000100:00100000:1.0:1788890858.817252:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000159a8162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+10:5795:x1875787996202368:12345-0@lo:101: Request processed in 100us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.817268:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788890858.817274:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202368:0@lo:101: 00010000:00010000:0.0:1788890858.817285:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.817291:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890858.817697:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202496:0@lo:256: 00000100:00100000:0.0:1788890858.817721:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890858.817738:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8f4b88d going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.817770:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996202496 00000100:00100000:1.0:1788890858.817775:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996202496 00000100:00100000:1.0:1788890858.817802:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788890858.817808:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d29135e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:5795:x1875787996202496:12345-0@lo:256: 20000000:01000000:1.0:1788890858.817821:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788890858.817826:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788890858.817891:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d29135e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:5795:x1875787996202496:12345-0@lo:256: Request processed in 83us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.817896:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890858.817906:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202496:0@lo:256: 10000000:01000000:0.0:1788890858.818333:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788890858.818341:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.818347:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890858.818351:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1c9db0800 from 1 10000000:01000000:0.0:1788890858.818352:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890858.818363:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.818367:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.818372:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890858.818383:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202624:0@lo:101: 00000100:00100000:0.0:1788890858.818399:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890858.818415:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8f4b88d going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.818443:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996202624 00000100:00100000:1.0:1788890858.818448:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996202624 00000100:00100000:1.0:1788890858.818473:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788890858.818490:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de390b37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+10:5795:x1875787996202624:12345-0@lo:101: 00010000:00010000:1.0:1788890858.818497:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890858.818505:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ebbc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.818519:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ebbc expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.818527:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ebbc expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.818534:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004afedc55, rc 0) 00000100:00100000:1.0:1788890858.818564:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de390b37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:5795:x1875787996202624:12345-0@lo:101: Request processed in 85us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.818571:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788890858.818584:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202624:0@lo:101: 00010000:00010000:0.0:1788890858.818593:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.818600:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890858.818638:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202752:0@lo:501: 00000100:00100000:0.0:1788890858.818661:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890858.818677:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8f4b88d going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.818698:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996202752 00000100:00100000:1.0:1788890858.818703:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996202752 00000100:00100000:1.0:1788890858.818726:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788890858.818733:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcc6f586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:5795:x1875787996202752:12345-0@lo:501: 00000100:00100000:1.0:1788890858.819231:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcc6f586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:5795:x1875787996202752:12345-0@lo:501: Request processed in 499us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.819240:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788890858.819246:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202752:0@lo:501: 00000100:00100000:0.0:1788890858.819271:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202880:0@lo:503: 00000100:00100000:0.0:1788890858.819301:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890858.819322:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8f4b88d going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.819323:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996202880 00000100:00100000:1.0:1788890858.819328:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996202880 00000100:00100000:1.0:1788890858.819348:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788890858.819352:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f64fd969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:5795:x1875787996202880:12345-0@lo:503: 00000040:00080000:1.0:1788890858.819373:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788890858.819406:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f64fd969 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:5795:x1875787996202880:12345-0@lo:503: Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.819411:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890858.819422:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ddc7cba3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996202880:0@lo:503: 00000040:00080000:0.0:1788890858.820076:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788890858.820127:0:5795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788890858.820143:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788890858.820160:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.820195:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890858.820234:0:5795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788890858.820237:0:5795:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9da1c9db0800 10000000:01000000:3.0:1788890858.820239:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9da1c9db0800 10000000:01000000:3.0:1788890858.820243:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788890858.820248:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1c9db0800 from 1 10000000:01000000:3.0:1788890858.820249:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788890858.820263:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.820267:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.820271:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890858.820279:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996203008:0@lo:101: 00000100:00100000:3.0:1788890858.820299:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.820319:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7247478 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.820334:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996203008 00000100:00100000:1.0:1788890858.820338:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996203008 00000100:00100000:1.0:1788890858.820361:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788890858.820367:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043e7cc15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:5795:x1875787996203008:12345-0@lo:101: 00010000:00010000:1.0:1788890858.820374:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890858.820382:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ebca expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.820397:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ebca expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.820405:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ebca expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.820423:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039cc850b, rc 0) 00000100:00100000:1.0:1788890858.820453:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043e7cc15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5795:x1875787996203008:12345-0@lo:101: Request processed in 87us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.820459:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788890858.820495:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996203008:0@lo:101: 00010000:00010000:3.0:1788890858.820504:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.820511:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890858.820548:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996203136:0@lo:501: 00000100:00100000:3.0:1788890858.820575:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.820591:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7247478 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.820596:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996203136 00000100:00100000:1.0:1788890858.820600:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996203136 00000100:00100000:1.0:1788890858.820621:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788890858.820626:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb95104e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5795:x1875787996203136:12345-0@lo:501: 00000100:00100000:1.0:1788890858.820762:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb95104e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5795:x1875787996203136:12345-0@lo:501: Request processed in 137us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.820767:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788890858.820795:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996203136:0@lo:501: 00000100:00100000:3.0:1788890858.820815:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996203264:0@lo:503: 00000100:00100000:3.0:1788890858.820853:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.820865:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7247478 going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.820870:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996203264 00000100:00100000:1.0:1788890858.820874:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996203264 00000100:00100000:1.0:1788890858.820894:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788890858.820899:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e484689e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5795:x1875787996203264:12345-0@lo:503: 00000100:00100000:1.0:1788890858.821099:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e484689e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5795:x1875787996203264:12345-0@lo:503: Request processed in 200us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.821103:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788890858.821124:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbeae3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996203264:0@lo:503: 00000100:00100000:1.0:1788890858.821309:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000974576be pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:5842:1875787996203392:0@lo:502: 00000100:00100000:1.0:1788890858.821330:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890858.821347:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb37694f going to sleep for 11 seconds 00000100:00100000:2.0:1788890858.821361:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996203392 00000100:00100000:2.0:1788890858.821366:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996203392 00000100:00100000:2.0:1788890858.821394:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788890858.821400:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ccd55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5842:x1875787996203392:12345-0@lo:502: 00000100:00100000:2.0:1788890858.821578:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ccd55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5842:x1875787996203392:12345-0@lo:502: Request processed in 178us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890858.821587:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788890858.821597:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000974576be pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:5842:1875787996203392:0@lo:502: 00000020:01000004:1.0:1788890858.821639:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788890858.821651:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005e868a1a) 00000020:00000080:1.0:1788890858.821663:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788890858.821716:0:5842:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c69bb2e5 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788890858.821719:0:5842:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c69bb2e5 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788890858.821720:0:5842:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c69bb2e5 4 00010000:00080000:1.0:1788890858.821747:0:5842:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000038251ab0@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.118@tcp at head 00010000:00010000:1.0:1788890858.822904:0:5842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788890858.823045:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788890858.823061:0:5842:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788890858.823067:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9161b78f8ec3ebdf 00000100:00080000:1.0:1788890858.823072:0:5842:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788890858.823075:0:5842:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000038251ab0 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:1.0:1788890858.823093:0:5842:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000974576be x1875787996203520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788890858.823110:0:5842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788890858.823150:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000974576be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996203520:0@lo:38: 00000100:00100000:3.0:1788890858.823230:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890858.823260:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002f0ff4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:5842:1875787996203648:0@lo:502: 00000100:00100000:3.0:1788890858.823297:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996203520 00000100:00100000:1.0:1788890858.823302:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.823303:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996203520 00000100:00100000:1.0:1788890858.823324:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e9f7640 going to sleep for 11 seconds 00000100:00100000:3.0:1788890858.823333:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890858.823340:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbeae3aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1875787996203520:12345-0@lo:38: 00000100:00100000:0.0:1788890858.823343:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996203648 00000100:00100000:0.0:1788890858.823349:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996203648 00000100:00100000:0.0:1788890858.823386:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788890858.823392:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbeae3aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1875787996203520:12345-0@lo:38: Request processed in 51us (163us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788890858.823397:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd69d57b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5842:x1875787996203648:12345-0@lo:502: 00000100:00100000:3.0:1788890858.823404:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890858.823436:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788890858.823442:0:3278:0:(import.c:65:import_set_state_nolock()) 0000000038251ab0 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788890858.823446:0:3278:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788890858.823449:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000974576be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996203520:0@lo:38: 00000100:00100000:0.0:1788890858.823577:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd69d57b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5842:x1875787996203648:12345-0@lo:502: Request processed in 185us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890858.823591:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788890858.823596:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002f0ff4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:5842:1875787996203648:0@lo:502: 00000040:00080000:1.0:1788890858.823614:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788890858.823681:0:5795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788890858.823699:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788890858.823711:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.823727:0:5795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788890858.823772:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788890858.823775:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788890858.823777:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890858.823778:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890858.823779:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890858.823780:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890858.823782:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788890858.823783:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788890858.823785:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890858.823786:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890858.823788:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890858.823790:0:5795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788890858.823793:0:5795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788890858.823795:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788890858.823796:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788890858.823797:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890858.823798:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890858.823798:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890858.823799:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890858.823800:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788890858.823801:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788890858.823801:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890858.823802:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890858.823802:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890858.823803:0:5795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788890858.823817:0:5795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788890858.823825:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996203776:0@lo:253: 00000100:00100000:3.0:1788890858.823872:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.823893:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078e8559c going to sleep for 11 seconds 00000100:00100000:1.0:1788890858.823911:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996203776 00000100:00100000:1.0:1788890858.823916:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996203776 00000100:00100000:1.0:1788890858.823950:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788890858.823958:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040e4eab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5795:x1875787996203776:12345-0@lo:253: 20000000:01000000:1.0:1788890858.823978:0:5808:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788890858.823990:0:5808:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788890858.834228:0:5808:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788890858.834242:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788890858.834249:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788890858.834254:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788890858.834270:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.834291:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ebae expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.834296:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.834324:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ebae expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890858.834336:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebae expref: 12 pid: 5808 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890858.834347:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002f0ff4a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875787996203904:0@lo:104: 00000100:00100000:1.0:1788890858.834409:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890858.834456:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996203904 00000100:00100000:1.0:1788890858.834457:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f71538e3 going to sleep for 11 seconds 00000100:00100000:2.0:1788890858.834464:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996203904 00000100:00100000:2.0:1788890858.834509:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890858.834519:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fcc5e92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5830:x1875787996203904:12345-0@lo:104: 00010000:00010000:2.0:1788890858.834530:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890858.834539:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788890858.834548:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788890858.834591:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890858.834597:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fcc5e92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5830:x1875787996203904:12345-0@lo:104: Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890858.834606:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002f0ff4a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875787996203904:0@lo:104: 00000100:00100000:2.0:1788890858.834607:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788890858.834630:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.834633:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890858.834641:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.834650:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000280e4742 already unused, calling callback (00000000f3159a9c) 10000000:00010000:2.0:1788890858.834655:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.834675:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890858.834683:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890858.834689:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890858.834728:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.834736:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890858.834762:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.834769:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: 00000000280e4742/0x9161b78f8ec3ebae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ebb5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890858.834789:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890858.834791:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890858.834793:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890858.834851:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c0b5384 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996204032:0@lo:103: 00000100:00100000:0.0:1788890858.834885:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890858.834932:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996204032 00000100:00100000:3.0:1788890858.834938:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996204032 00010000:00010000:3.0:1788890858.834957:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebae expref: 13 pid: 5808 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890858.834989:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890858.834997:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddc7cba3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:3280:x1875787996204032:12345-0@lo:103: 00010000:00010000:3.0:1788890858.835008:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890858.835012:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebae expref: 13 pid: 5808 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835022:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebae expref: 13 pid: 5808 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835035:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012a97a76/0x9161b78f8ec3ebb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ebae expref: 13 pid: 5808 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835047:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835055:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788890858.835067:0:5799:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000813853s 00010000:00010000:3.0:1788890858.835070:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835076:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835082:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835087:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835098:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005a78f3d already unused, calling callback (0000000063948432) 00010000:00010000:3.0:1788890858.835101:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835107:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835123:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890858.835134:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890858.835134:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.835142:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890858.835146:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005a78f3d/0x9161b78f8ec3ebe6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890858.835194:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddc7cba3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+12:3280:x1875787996204032:12345-0@lo:103: Request processed in 198us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890858.835202:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788890858.835204:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c0b5384 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996204032:0@lo:103: 00000100:00100000:1.0:1788890858.836658:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040e4eab8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:5795:x1875787996203776:12345-0@lo:253: Request processed in 12702us (12786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890858.836666:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788890858.836702:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:5795:1875787996203776:0@lo:253: 10000000:01000000:3.0:1788890858.836713:0:5795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788890858.836716:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788890858.836717:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788890858.836718:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890858.836720:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890858.836721:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890858.836722:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890858.836723:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788890858.836725:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788890858.836726:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890858.836727:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890858.836729:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890858.836730:0:5795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788890858.836740:0:5795:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788890858.840884:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788890858.841276:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788890858.841499:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788890858.841662:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788890858.841856:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788890858.842010:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788890858.842546:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788890858.842742:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788890858.842947:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788890858.843116:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788890858.843343:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788890858.843521:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788890858.854838:0:5795:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:1.0:1788890858.865915:0:5848:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000040:01000000:0.0:1788890858.865915:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788890858.865921:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788890858.866079:0:5849:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788890858.869807:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788890858.870351:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788890858.870706:0:5795:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788890858.870711:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788890858.870821:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890858.871577:0:5795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788890858.871973:0:5795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788890858.871988:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788890858.872121:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788890858.872387:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788890858.874164:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788890858.874495:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788890858.874687:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788890858.874968:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788890858.875326:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788890858.875557:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788890858.875738:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788890858.875928:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788890858.876035:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788890858.876263:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788890858.876447:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788890858.876619:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788890858.876732:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788890858.876898:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788890858.877039:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788890858.877164:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788890858.877501:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000040:00080000:0.0:1788890858.877571:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1788890858.877693:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788890858.878063:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788890858.878377:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788890858.878681:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788890858.879043:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788890858.879377:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788890858.879672:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788890858.879906:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788890858.880116:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788890858.880349:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788890858.880614:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788890858.880931:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788890858.881256:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788890858.881578:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788890858.881876:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788890858.882292:0:5795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788890858.894645:0:5849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788890858.894714:0:5849:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788890858.894719:0:5849:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1788890858.904673:0:5795:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788890858.904708:0:5795:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd5081ce3988 00100000:10000000:1.0:1788890858.904717:0:5795:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788890858.904972:0:5795:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788890858.904984:0:5795:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788890858.904993:0:5795:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788890858.905018:0:5795:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788890859.639461:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890860.362292:0:6091:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788890860.662293:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890861.686341:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788890862.655678:0:6292:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5856dba0 20000000:00000080:2.0:1788890862.655693:0:6292:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9da1d0688400 uarg=0000000000000000 20000000:01000000:2.0:1788890862.655724:0:6292:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788890862.655729:0:6292:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788890862.655734:0:6292:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788890862.655999:0:6292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788890862.656008:0:6292:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788890862.658286:0:6292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788890862.658493:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788890862.658534:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788890862.658588:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788890862.658604:0:6292:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788890862.658618:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890862.658631:0:6292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ebbc expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890862.658636:0:6292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890862.658666:0:6292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ebbc expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890862.658675:0:6292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebbc expref: 10 pid: 5808 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890862.658684:0:6292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017b9d761 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6292:1875787996204160:0@lo:104: 00000100:00100000:2.0:1788890862.658732:0:6292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890862.658789:0:6292:0:(client.c:2715:ptlrpc_set_wait()) set 00000000995eb3dd going to sleep for 11 seconds 00000100:00100000:0.0:1788890862.658792:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996204160 00000100:00100000:0.0:1788890862.658813:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996204160 00000100:00100000:0.0:1788890862.658871:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890862.658880:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aabfc413 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+3:6292:x1875787996204160:12345-0@lo:104: 00010000:00010000:0.0:1788890862.658891:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.658942:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788890862.658947:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aabfc413 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+3:6292:x1875787996204160:12345-0@lo:104: Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890862.658954:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788890862.658959:0:6292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017b9d761 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6292:1875787996204160:0@lo:104: 00010000:00010000:2.0:1788890862.658973:0:6292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.658973:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890862.658977:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.658983:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d42f716c already unused, calling callback (00000000f3159a9c) 10000000:00010000:0.0:1788890862.658986:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.658993:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890862.658999:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890862.659004:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788890862.659029:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659035:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890862.659063:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659069:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: 00000000d42f716c/0x9161b78f8ec3ebbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ebc3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659082:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890862.659084:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890862.659086:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890862.659126:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c90ad89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996204288:0@lo:103: 00000100:00100000:1.0:1788890862.659161:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890862.659214:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996204288 00000100:00100000:0.0:1788890862.659219:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996204288 00010000:00010000:0.0:1788890862.659236:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebbc expref: 11 pid: 5808 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890862.659265:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890862.659272:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0fb9b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:3281:x1875787996204288:12345-0@lo:103: 00010000:00010000:0.0:1788890862.659282:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890862.659287:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebbc expref: 11 pid: 5808 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659295:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebbc expref: 11 pid: 5808 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659305:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004afedc55/0x9161b78f8ec3ebc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ebbc expref: 11 pid: 5808 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659316:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659323:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659343:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659349:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659353:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659358:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659363:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cf3d5f4f already unused, calling callback (0000000063948432) 00010000:00010000:0.0:1788890862.659365:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659372:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659395:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890862.659404:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890862.659436:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0fb9b82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:3281:x1875787996204288:12345-0@lo:103: Request processed in 165us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890862.659442:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788890862.659447:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c90ad89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996204288:0@lo:103: 00010000:00010000:1.0:1788890862.659815:0:6292:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890862.659826:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890862.659842:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cf3d5f4f/0x9161b78f8ec3ebed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890862.710826:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890863.734356:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788890864.182287:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788890864.182296:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788890864.182299:0:485:0:(import.c:65:import_set_state_nolock()) 0000000038251ab0 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788890864.182311:0:485:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000038251ab0 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788890864.182331:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e88ab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996204416:0@lo:400: 00000100:00100000:1.0:1788890864.182333:0:485:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b6c197a7 x1875787996204544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788890864.182387:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6c197a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996204544:0@lo:38: 00000100:00100000:3.0:1788890864.182415:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890864.182485:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.182494:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996204416 00000100:00100000:3.0:1788890864.182503:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996204416 00000100:00100000:1.0:1788890864.182544:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996204544 00000100:00100000:1.0:1788890864.182550:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996204544 00000100:00100000:3.0:1788890864.182551:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788890864.182562:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2750bbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:3282:x1875787996204416:12345-0@lo:400: 00000100:00100000:1.0:1788890864.182628:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788890864.182629:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2750bbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:3282:x1875787996204416:12345-0@lo:400: Request processed in 65us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890864.182638:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031bcb81c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1875787996204544:12345-0@lo:38: 00000100:00100000:3.0:1788890864.182643:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788890864.182662:0:5814:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 88 last 0 00000100:00100000:3.0:1788890864.182699:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e88ab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996204416:0@lo:400: 00000020:00000080:1.0:1788890864.182705:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9161b78f8ec3ebf4 00000004:00100000:1.0:1788890864.182790:0:5814:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788890864.182970:0:5814:0:(import.c:65:import_set_state_nolock()) 0000000053ca64ff : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788890864.183016:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031bcb81c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875787996204544:12345-0@lo:38: Request processed in 379us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890864.183024:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788890864.183079:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b6c197a7 x1875787996204544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788890874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788890864.183094:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788890864.183101:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788890864.183115:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788890864.183119:0:3278:0:(import.c:65:import_set_state_nolock()) 0000000038251ab0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788890864.183126:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6c197a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996204544:0@lo:38: 00000020:01000004:3.0:1788890864.644364:0:6659:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788890864.644368:0:6659:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788890864.644489:0:6659:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008e0a6eff 00000020:01000004:3.0:1788890864.644503:0:6659:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788890864.644514:0:6659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788890864.644530:0:6659:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000671fb9c0) 00000020:00000080:3.0:1788890864.644544:0:6659:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788890864.651139:0:6659:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788890864.651299:0:6659:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788890864.661042:0:6659:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788890864.663683:0:6659:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788890864.663697:0:6659:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788890864.663754:0:6659:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788890864.663780:0:6659:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788890864.664072:0:6659:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788890864.664082:0:6659:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788890864.664092:0:6659:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9161b78f8ec3ec02 00000020:01000004:3.0:1788890864.664099:0:6659:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788890864.664119:0:6659:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788890864.664122:0:6659:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788890864.664129:0:6659:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788890864.664133:0:6659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788890864.664143:0:6659:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000087e6b9f) 00000020:00000080:3.0:1788890864.664153:0:6659:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788890864.665478:0:6659:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788890864.665634:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788890864.665640:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788890864.666004:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788890864.666017:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788890864.666199:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788890864.666206:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788890864.667155:0:6659:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788890864.667292:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788890864.667295:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788890864.667564:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788890864.667571:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788890864.679022:0:6659:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788890864.679262:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788890864.679269:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788890864.680545:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788890864.680551:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788890864.680899:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788890864.680904:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788890864.682944:0:6659:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788890864.683066:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788890864.683069:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788890864.683518:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788890864.683523:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788890864.707851:0:6659:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788890864.708038:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788890864.708044:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788890864.708844:0:6659:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788890864.708850:0:6659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788890864.709118:0:6659:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788890864.709136:0:6659:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788890864.709141:0:6659:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788890864.718989:0:6659:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788890864.719019:0:6659:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.118@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788890864.719022:0:6659:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788890864.719023:0:6659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788890864.719025:0:6659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890864.719025:0:6659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890864.719026:0:6659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890864.719027:0:6659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890864.719028:0:6659:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890864.719029:0:6659:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890864.719030:0:6659:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890864.719031:0:6659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890864.719031:0:6659:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788890864.719034:0:6659:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788890864.719035:0:6659:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788890864.719036:0:6659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788890864.719036:0:6659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890864.719037:0:6659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890864.719037:0:6659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890864.719038:0:6659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890864.719039:0:6659:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890864.719039:0:6659:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890864.719040:0:6659:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890864.719041:0:6659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890864.719041:0:6659:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788890864.719066:0:6659:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788890864.719078:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996204672:0@lo:253: 00000100:00100000:3.0:1788890864.719133:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.719195:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068d31959 going to sleep for 11 seconds 00000100:00100000:1.0:1788890864.719209:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996204672 00000100:00100000:1.0:1788890864.719217:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996204672 00000100:00100000:1.0:1788890864.719263:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788890864.719278:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000699824f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996204672:12345-0@lo:253: 20000000:01000000:1.0:1788890864.719304:0:5808:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788890864.719307:0:5808:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788890864.719311:0:5808:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788890864.719313:0:5808:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788890864.719947:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890864.720117:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788890864.720129:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788890864.720181:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788890864.720190:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788890864.720225:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788890864.720284:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788890864.720630:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788890864.720645:0:5808:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.118@tcp 20000000:01000000:1.0:1788890864.720647:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.118@tcp (null) (null) (null) 00000040:00080000:1.0:1788890864.720681:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788890864.720688:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788890864.720743:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788890864.720749:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.118@tcp (null) (null) 00000040:00080000:1.0:1788890864.720767:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788890864.720772:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788890864.720797:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788890864.720840:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788890864.721373:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788890864.721382:0:5808:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.118@tcp 20000000:01000000:1.0:1788890864.721383:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.118@tcp (null) (null) (null) 00000040:00080000:1.0:1788890864.721401:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788890864.721404:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788890864.721419:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788890864.721423:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.118@tcp (null) (null) 00000040:00080000:1.0:1788890864.721450:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788890864.721465:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788890864.721508:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788890864.721545:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788890864.721560:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788890864.721562:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788890864.721567:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788890864.721569:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788890864.721571:0:5808:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788890864.721583:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788890864.721585:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788890864.721611:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788890864.721613:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788890864.722007:0:6674:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788890864.722047:0:6674:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788890864.722095:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788890864.722301:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788890864.722327:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788890864.722361:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788890864.722373:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788890864.722375:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788890864.722685:0:6675:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788890864.722742:0:6675:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788890864.722775:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788890864.722934:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788890864.722961:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788890864.723013:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788890864.723025:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788890864.723027:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788890864.723297:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788890864.723417:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788890864.723452:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788890864.723519:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1788890864.723536:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788890864.723561:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.723583:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eb3e expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.723587:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eb5a expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.723591:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ebca expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.723597:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.723630:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ebca expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.723643:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebca expref: 10 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890864.723656:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017b9d761 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996204800:0@lo:104: 00000100:00100000:2.0:1788890864.723733:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890864.723772:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996204800 00010000:00010000:2.0:1788890864.723777:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3eb5a expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890864.723780:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996204800 00010000:00010000:2.0:1788890864.723787:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3eb5a expref: 10 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890864.723793:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000110e1ace pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996204928:0@lo:104: 00000100:00100000:2.0:1788890864.723809:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890864.723835:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996204928 00000100:00100000:0.0:1788890864.723839:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996204928 00010000:00010000:2.0:1788890864.723853:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3eb3e expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890864.723860:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788890864.723871:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051f581b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+4:5808:x1875787996204800:12345-0@lo:104: 00010000:00010000:2.0:1788890864.723873:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3eb3e expref: 10 pid: 5808 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.723874:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788890864.723882:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:0.0:1788890864.723887:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890864.723891:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a726dd16 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996205056:0@lo:104: 00000100:00100000:1.0:1788890864.723891:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d777328 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+4:5808:x1875787996204928:12345-0@lo:104: 00000100:00100000:3.0:1788890864.723898:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:1.0:1788890864.723908:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890864.723936:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890864.723955:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053dab1d7 going to sleep for 11 seconds 00010000:00010000:0.0:1788890864.723969:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890864.723975:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051f581b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+4:5808:x1875787996204800:12345-0@lo:104: Request processed in 107us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.723977:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017b9d761 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996204800:0@lo:104: 00010000:00010000:1.0:1788890864.723979:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890864.723986:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890864.723990:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d777328 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+4:5808:x1875787996204928:12345-0@lo:104: Request processed in 103us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.723996:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000110e1ace pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996204928:0@lo:104: 00000100:00100000:1.0:1788890864.724000:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788890864.724003:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996205056 00000100:00100000:0.0:1788890864.724007:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996205056 00000100:00100000:1.0:1788890864.724033:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788890864.724044:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5de2c17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5808:x1875787996205056:12345-0@lo:104: 00010000:00010000:1.0:1788890864.724052:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724053:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788890864.724060:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724067:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000db46305 already unused, calling callback (00000000f3159a9c) 10000000:00010000:0.0:1788890864.724069:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724084:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890864.724089:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890864.724093:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788890864.724095:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788890864.724108:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5de2c17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5808:x1875787996205056:12345-0@lo:104: Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890864.724115:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788890864.724120:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a726dd16 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996205056:0@lo:104: 00010000:00010000:0.0:1788890864.724127:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724133:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788890864.724140:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788890864.724146:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724156:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724162:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: 000000000db46305/0x9161b78f8ec3ebca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ebd1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.724165:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000abaed8d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996205184:0@lo:103: 00010000:00010000:0.0:1788890864.724194:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890864.724198:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724203:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f84096e6 already unused, calling callback (00000000f3159a9c) 10000000:00010000:0.0:1788890864.724204:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724208:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890864.724211:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890864.724216:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788890864.724229:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890864.724246:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724254:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788890864.724261:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788890864.724266:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.724269:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e08e3fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996205312:0@lo:103: 00010000:00010000:0.0:1788890864.724300:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: 00000000f84096e6/0x9161b78f8ec3eb3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eb45 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.724302:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996205184 00000100:00100000:1.0:1788890864.724309:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996205184 00010000:00010000:0.0:1788890864.724316:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890864.724319:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890864.724320:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890864.724321:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890864.724331:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebca expref: 11 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.724362:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996205312 00000100:00100000:1.0:1788890864.724366:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996205312 00000100:00100000:2.0:1788890864.724368:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890864.724378:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000609d7964 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:3279:x1875787996205184:12345-0@lo:103: 00010000:00010000:1.0:1788890864.724383:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eb3e expref: 12 pid: 5808 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724384:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890864.724387:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890864.724390:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890864.724391:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890864.724397:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebca expref: 12 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724401:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.724404:0:5799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788890864.724414:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ebca expref: 12 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724416:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000054c20b47 already unused, calling callback (00000000f3159a9c) 10000000:00010000:0.0:1788890864.724420:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.724425:0:5799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788890864.724434:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.724438:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000039cc850b/0x9161b78f8ec3ebd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ebca expref: 12 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.724448:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 10000000:00010000:0.0:1788890864.724448:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.724459:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:0.0:1788890864.724459:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788890864.724462:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788890864.724472:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d29dca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:3279:x1875787996205312:12345-0@lo:103: 00010000:00010000:1.0:1788890864.724482:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890864.724486:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.724487:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eb3e expref: 11 pid: 5808 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890864.724497:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000609d7964 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:3279:x1875787996205184:12345-0@lo:103: Request processed in 120us (266us total) trans 0 rc 0/0 00010000:00010000:1.0:1788890864.724501:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3eb3e expref: 11 pid: 5808 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.724510:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788890864.724520:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3eb45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3eb3e expref: 11 pid: 5808 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890864.724523:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788890864.724534:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.724540:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890864.724542:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: 0000000054c20b47/0x9161b78f8ec3eb5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eb61 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.724551:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000abaed8d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996205184:0@lo:103: 00000100:00100000:1.0:1788890864.724576:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d29dca6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:3279:x1875787996205312:12345-0@lo:103: Request processed in 104us (257us total) trans 0 rc 0/0 00010000:00010000:0.0:1788890864.724579:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890864.724580:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e08e3fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996205312:0@lo:103: 00010000:00010000:0.0:1788890864.724582:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890864.724586:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890864.724595:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788890864.724597:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788890864.724608:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071a79295 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996205440:0@lo:103: 00000100:00100000:0.0:1788890864.724640:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.724675:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996205440 00000100:00100000:3.0:1788890864.724679:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996205440 00010000:00010000:3.0:1788890864.724694:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eb5a expref: 9 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.724738:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788890864.724745:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000748e5e22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:3282:x1875787996205440:12345-0@lo:103: 00010000:00010000:3.0:1788890864.724752:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890864.724755:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eb5a expref: 9 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724763:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3eb5a expref: 9 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724772:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001165aa53/0x9161b78f8ec3eb61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3eb5a expref: 9 pid: 5810 timeout: 238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724782:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724788:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724806:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724810:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724813:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724816:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724819:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003c84b233 already unused, calling callback (0000000063948432) 00010000:00010000:3.0:1788890864.724821:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724824:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724834:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.724842:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890864.724853:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.724860:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.724865:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec10 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.724873:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000748e5e22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+8:3282:x1875787996205440:12345-0@lo:103: Request processed in 130us (235us total) trans 0 rc 0/0 20000000:01000000:2.0:1788890864.724877:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788890864.724878:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788890864.725034:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071a79295 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996205440:0@lo:103: 00000100:00100000:1.0:1788890864.735446:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000699824f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+7:6659:x1875787996204672:12345-0@lo:253: Request processed in 16163us (16306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890864.735461:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788890864.735464:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996204672:0@lo:253: 10000000:01000000:3.0:1788890864.735484:0:6659:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788890864.735487:0:6659:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788890864.735498:0:6659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788890864.735500:0:6659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890864.735501:0:6659:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788890864.735502:0:6659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890864.735503:0:6659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890864.735505:0:6659:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890864.735506:0:6659:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788890864.735507:0:6659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890864.735509:0:6659:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788890864.735526:0:6659:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008e0a6eff from lustre-OST0000 10000000:01000000:3.0:1788890864.735548:0:6659:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788890864.735550:0:6659:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788890864.735556:0:6659:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9da1f024b370 local copy 10000000:01000000:3.0:1788890864.735560:0:6659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788890864.735590:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.735600:0:6659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.735608:0:6659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.735623:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996205568:0@lo:101: 00000100:00100000:3.0:1788890864.735654:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890864.735699:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996205568 00000100:00100000:3.0:1788890864.735701:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1583ab4 going to sleep for 11 seconds 00000100:00100000:0.0:1788890864.735706:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996205568 00000100:00100000:0.0:1788890864.735752:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788890864.735767:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062b4f994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+7:6659:x1875787996205568:12345-0@lo:101: 00010000:00010000:0.0:1788890864.735779:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890864.735791:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbb12dfc/0x9161b78f8ec3ec1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ec17 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.735813:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbb12dfc/0x9161b78f8ec3ec1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec17 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.735822:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbb12dfc/0x9161b78f8ec3ec1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec17 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.735831:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbb12dfc, rc 0) 00000100:00100000:0.0:1788890864.735859:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062b4f994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+8:6659:x1875787996205568:12345-0@lo:101: Request processed in 101us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890864.735864:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788890864.735878:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996205568:0@lo:101: 00010000:00010000:3.0:1788890864.735890:0:6659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.735899:0:6659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.735972:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996205696:0@lo:501: 00000100:00100000:3.0:1788890864.735990:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.736002:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1583ab4 going to sleep for 11 seconds 00000100:00100000:1.0:1788890864.736023:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996205696 00000100:00100000:1.0:1788890864.736028:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996205696 00000100:00100000:1.0:1788890864.736050:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788890864.736054:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002972a926 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+8:6659:x1875787996205696:12345-0@lo:501: 00000100:00100000:3.0:1788890864.736203:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996205696:0@lo:501: 00000100:00100000:1.0:1788890864.736204:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002972a926 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+8:6659:x1875787996205696:12345-0@lo:501: Request processed in 148us (211us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788890864.736214:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 10000000:01000000:3.0:1788890864.736224:0:6659:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788890864.736246:0:6659:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788890864.736250:0:6659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.736255:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.736259:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.736270:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788890864.736281:0:6659:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9da1f4e26000 10000000:01000000:3.0:1788890864.736283:0:6659:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788890864.736286:0:6659:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9da1f024b370 10000000:01000000:3.0:1788890864.736287:0:6659:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788890864.736289:0:6659:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9da1f024b370 from 1 10000000:01000000:3.0:1788890864.736291:0:6659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788890864.736295:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890864.736300:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 000000009ef861b6/0x9161b78f8ec3ec25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.736302:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.736305:0:6659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: 000000009ef861b6/0x9161b78f8ec3ec25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890864.736318:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030e5d8ba already unused, calling callback (00000000f3159a9c) 00010000:00010000:3.0:1788890864.736321:0:6659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 000000009ef861b6/0x9161b78f8ec3ec25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890864.736323:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.736332:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996205824:0@lo:101: 00010000:00010000:0.0:1788890864.736334:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890864.736342:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890864.736347:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788890864.736353:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890864.736367:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.736373:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1ca080f going to sleep for 11 seconds 00010000:00010000:0.0:1788890864.736374:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788890864.736392:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996205824 00000100:00100000:1.0:1788890864.736396:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996205824 00010000:00010000:0.0:1788890864.736400:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.736404:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071a79295 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996205952:0@lo:103: 00000100:00100000:1.0:1788890864.736414:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788890864.736414:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: 0000000030e5d8ba/0x9161b78f8ec3ec17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9161b78f8ec3ec1e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.736427:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000754d5f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+8:6659:x1875787996205824:12345-0@lo:101: 00010000:00010000:0.0:1788890864.736433:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890864.736434:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788890864.736435:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890864.736437:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890864.736442:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890864.736447:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3ec2c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ec25 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.736464:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3ec2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec25 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890864.736467:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996205952 00000100:00100000:2.0:1788890864.736472:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996205952 00010000:00010000:1.0:1788890864.736476:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000048bfdff/0x9161b78f8ec3ec2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec25 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.736484:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000048bfdff, rc 0) 00000100:00100000:2.0:1788890864.736504:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890864.736511:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071447db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+10:3282:x1875787996205952:12345-0@lo:103: 00010000:00010000:2.0:1788890864.736519:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788890864.736523:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000754d5f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996205824:12345-0@lo:101: Request processed in 98us (169us total) trans 0 rc 0/0 00010000:00010000:2.0:1788890864.736532:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bbb12dfc/0x9161b78f8ec3ec1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ec17 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.736539:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788890864.736553:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890864.736591:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071447db9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+8:3282:x1875787996205952:12345-0@lo:103: Request processed in 79us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890864.736597:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de846bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996205824:0@lo:101: 00000100:00100000:2.0:1788890864.736600:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890864.736602:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071a79295 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996205952:0@lo:103: 00010000:00010000:1.0:1788890864.736618:0:6659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 000000009ef861b6/0x9161b78f8ec3ec25 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec2c expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.736625:0:6659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 000000009ef861b6/0x9161b78f8ec3ec25 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ec2c expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890864.736636:0:6659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788890864.736644:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 000000009ef861b6/0x9161b78f8ec3ec25 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec2c expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.736649:0:6659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: 000000009ef861b6/0x9161b78f8ec3ec25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec2c expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890864.736654:0:6659:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788890864.736656:0:6659:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788890864.736659:0:6659:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788890864.736660:0:6659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788890864.736669:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 0000000012a97a76/0x9161b78f8ec3ec33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.736673:0:6659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: 0000000012a97a76/0x9161b78f8ec3ec33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.736677:0:6659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 0000000012a97a76/0x9161b78f8ec3ec33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.736684:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206080:0@lo:101: 00000100:00100000:1.0:1788890864.736706:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890864.736731:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005b62daa going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.736740:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996206080 00000100:00100000:2.0:1788890864.736745:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996206080 00000100:00100000:2.0:1788890864.736766:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788890864.736769:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bc2994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+8:6659:x1875787996206080:12345-0@lo:101: 00010000:00010000:2.0:1788890864.736774:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890864.736780:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ec33 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.736795:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec33 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.736799:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c84b233/0x9161b78f8ec3ec3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec33 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.736804:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c84b233, rc 0) 00000100:00100000:2.0:1788890864.736826:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bc2994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206080:12345-0@lo:101: Request processed in 56us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.736830:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788890864.736848:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206080:0@lo:101: 00010000:00010000:1.0:1788890864.736856:0:6659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 0000000012a97a76/0x9161b78f8ec3ec33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.736861:0:6659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 0000000012a97a76/0x9161b78f8ec3ec33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.736914:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206208:0@lo:501: 00000100:00100000:1.0:1788890864.736939:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890864.736955:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005b62daa going to sleep for 11 seconds 00000100:00100000:0.0:1788890864.736966:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996206208 00000100:00100000:0.0:1788890864.736969:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996206208 00000100:00100000:0.0:1788890864.736990:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788890864.736994:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d197d15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206208:12345-0@lo:501: 00000100:00100000:0.0:1788890864.737123:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d197d15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206208:12345-0@lo:501: Request processed in 128us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890864.737132:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788890864.737143:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206208:0@lo:501: 00000100:00100000:1.0:1788890864.737163:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206336:0@lo:503: 00000100:00100000:1.0:1788890864.737213:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890864.737236:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996206336 00000100:00100000:1.0:1788890864.737239:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005b62daa going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.737241:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996206336 00000100:00100000:2.0:1788890864.737271:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788890864.737277:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003bbd961 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206336:12345-0@lo:503: 00000100:00100000:2.0:1788890864.737390:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003bbd961 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206336:12345-0@lo:503: Request processed in 114us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.737398:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788890864.737414:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206336:0@lo:503: 00000040:00080000:1.0:1788890864.737654:0:6659:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788890864.737703:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206464:0@lo:502: 00000100:00100000:1.0:1788890864.737746:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890864.737765:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005b62daa going to sleep for 11 seconds 00000100:00100000:0.0:1788890864.737782:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996206464 00000100:00100000:0.0:1788890864.737787:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996206464 00000100:00100000:0.0:1788890864.737807:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788890864.737811:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000511d67a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206464:12345-0@lo:502: 00000100:00100000:0.0:1788890864.737936:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000511d67a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206464:12345-0@lo:502: Request processed in 124us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890864.737943:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890864.737957:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206464:0@lo:502: 00000040:00080000:1.0:1788890864.738160:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788890864.738228:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788890864.738260:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788890864.738299:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788890864.738338:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788890864.738365:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788890864.738384:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206592:0@lo:502: 00000100:00100000:1.0:1788890864.738413:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890864.738433:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005b62daa going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.738449:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996206592 00000100:00100000:2.0:1788890864.738454:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996206592 00000100:00100000:2.0:1788890864.738483:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788890864.738490:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a578e041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206592:12345-0@lo:502: 00000100:00100000:2.0:1788890864.738604:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a578e041 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206592:12345-0@lo:502: Request processed in 115us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.738611:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788890864.738627:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000827f6a9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206592:0@lo:502: 00000040:00080000:1.0:1788890864.738693:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788890864.738701:0:6659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788890864.739009:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788890864.739016:0:6680:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788890864.739022:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890864.739024:0:6680:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788890864.739029:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788890864.739042:0:6680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000003d039cb) 00000020:00000080:1.0:1788890864.739059:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788890864.739065:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788890864.739121:0:6680:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008e0a6eff from lustre-OST0000, refs=2 00080000:01000000:1.0:1788890864.739128:0:6680:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788890864.739134:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9161b78f8ec3ec48 00010000:00010000:1.0:1788890864.741866:0:6680:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788890864.742059:0:6680:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788890864.744039:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788890864.744193:0:6680:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788890864.747994:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788890864.748426:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788890864.751946:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788890864.751957:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890864.751963:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890864.751966:0:6680:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788890864.751969:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890864.751973:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890864.751987:0:6680:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788890864.751991:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788890864.751994:0:6680:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788890864.752048:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890864.752052:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890864.752054:0:6680:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788890864.752056:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788890864.752132:0:6659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788890864.752160:0:6659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788890864.752190:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: 0000000012a97a76/0x9161b78f8ec3ec33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.752200:0:6659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: 0000000012a97a76/0x9161b78f8ec3ec33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890864.752206:0:6659:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1f4e26000 from 1 10000000:01000000:3.0:1788890864.752208:0:6659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788890864.752238:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: 00000000165a3113/0x9161b78f8ec3ec4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.752243:0:6659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: 00000000165a3113/0x9161b78f8ec3ec4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.752251:0:6659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: 00000000165a3113/0x9161b78f8ec3ec4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.752276:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206720:0@lo:101: 00000100:00100000:3.0:1788890864.752327:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.752368:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f7a4575 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.752370:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996206720 00000100:00100000:2.0:1788890864.752378:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996206720 00000100:00100000:2.0:1788890864.752420:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788890864.752440:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003467fe5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:6659:x1875787996206720:12345-0@lo:101: 00010000:00010000:2.0:1788890864.752452:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890864.752463:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a9aeee1/0x9161b78f8ec3ec56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ec4f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.752484:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a9aeee1/0x9161b78f8ec3ec56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec4f expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.752494:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a9aeee1/0x9161b78f8ec3ec56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec4f expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.752503:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a9aeee1, rc 0) 00000100:00100000:2.0:1788890864.752539:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003467fe5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996206720:12345-0@lo:101: Request processed in 102us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.752544:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788890864.752571:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206720:0@lo:101: 00010000:00010000:3.0:1788890864.752583:0:6659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: 00000000165a3113/0x9161b78f8ec3ec4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.752589:0:6659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: 00000000165a3113/0x9161b78f8ec3ec4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890864.752660:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206848:0@lo:501: 00000100:00100000:3.0:1788890864.752680:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.752694:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f7a4575 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.752726:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996206848 00000100:00100000:2.0:1788890864.752730:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996206848 00000100:00100000:2.0:1788890864.752759:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788890864.752765:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a1427a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996206848:12345-0@lo:501: 00000100:00100000:2.0:1788890864.752955:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a1427a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996206848:12345-0@lo:501: Request processed in 190us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.752964:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788890864.752981:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206848:0@lo:501: 00000100:00100000:3.0:1788890864.753002:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206976:0@lo:503: 00000100:00100000:3.0:1788890864.753030:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.753043:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f7a4575 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.753059:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996206976 00000100:00100000:2.0:1788890864.753063:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996206976 00000100:00100000:2.0:1788890864.753087:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788890864.753094:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005063e10e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996206976:12345-0@lo:503: 00000100:00100000:2.0:1788890864.753323:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005063e10e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996206976:12345-0@lo:503: Request processed in 230us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.753340:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788890864.753350:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996206976:0@lo:503: 00000040:00080000:3.0:1788890864.753588:0:6659:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788890864.753635:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207104:0@lo:502: 00000100:00100000:3.0:1788890864.753664:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.753686:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f7a4575 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.753706:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996207104 00000100:00100000:2.0:1788890864.753770:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996207104 00000100:00100000:2.0:1788890864.753793:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788890864.753797:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007da766f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996207104:12345-0@lo:502: 00000100:00100000:2.0:1788890864.753904:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007da766f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996207104:12345-0@lo:502: Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.753908:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788890864.753929:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207104:0@lo:502: 00000040:00080000:3.0:1788890864.754161:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788890864.754241:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788890864.754257:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207232:0@lo:502: 00000100:00100000:3.0:1788890864.754282:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.754304:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f7a4575 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.754312:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996207232 00000100:00100000:2.0:1788890864.754316:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996207232 00000100:00100000:2.0:1788890864.754338:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788890864.754343:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003da44e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996207232:12345-0@lo:502: 00000100:00100000:2.0:1788890864.754446:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003da44e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996207232:12345-0@lo:502: Request processed in 103us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.754450:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788890864.754476:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c7f3e5d pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207232:0@lo:502: 00000040:00080000:3.0:1788890864.754534:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788890864.754540:0:6659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788890864.754813:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890864.754819:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890864.754821:0:6684:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788890864.754826:0:6684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1f4e26000 00000020:00000080:3.0:1788890864.754828:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788890864.754860:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890864.754862:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890864.754864:0:6684:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788890864.754866:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788890864.754910:0:6659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788890864.754936:0:6659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890864.754949:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.754959:0:6659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890864.755001:0:6659:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788890864.755004:0:6659:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9da1f4e26000 10000000:01000000:1.0:1788890864.755007:0:6659:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9da1f4e26000 10000000:01000000:1.0:1788890864.755011:0:6659:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788890864.755016:0:6659:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1f4e26000 from 1 10000000:01000000:1.0:1788890864.755019:0:6659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890864.755036:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.755044:0:6659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.755053:0:6659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.755072:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207360:0@lo:101: 00000100:00100000:1.0:1788890864.755112:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890864.755132:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da0c1102780 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.755148:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996207360 00000100:00100000:2.0:1788890864.755152:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996207360 00000100:00100000:2.0:1788890864.755192:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788890864.755201:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+10:6659:x1875787996207360:12345-0@lo:101: 00010000:00010000:2.0:1788890864.755209:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890864.755220:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ec5d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.755238:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec5d expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.755247:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec5d expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890864.755261:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29ef400, rc 0) 00000100:00100000:2.0:1788890864.755298:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996207360:12345-0@lo:101: Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.755303:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788890864.755313:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207360:0@lo:101: 00010000:00010000:1.0:1788890864.755326:0:6659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.755333:0:6659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890864.755380:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207488:0@lo:501: 00000100:00100000:1.0:1788890864.755404:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890864.755441:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996207488 00000100:00100000:1.0:1788890864.755442:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da0c1102780 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.755446:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996207488 00000100:00100000:2.0:1788890864.755475:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788890864.755484:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996207488:12345-0@lo:501: 00000100:00100000:2.0:1788890864.755643:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996207488:12345-0@lo:501: Request processed in 161us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.755647:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788890864.755676:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207488:0@lo:501: 00000100:00100000:3.0:1788890864.755697:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207616:0@lo:503: 00000100:00100000:3.0:1788890864.755747:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.755763:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c850c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.755780:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996207616 00000100:00100000:2.0:1788890864.755784:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996207616 00000100:00100000:2.0:1788890864.755801:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788890864.755805:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996207616:12345-0@lo:503: 00000100:00100000:2.0:1788890864.755890:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996207616:12345-0@lo:503: Request processed in 85us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.755895:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788890864.755917:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207616:0@lo:503: 00000040:00080000:3.0:1788890864.756033:0:6659:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788890864.756056:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207744:0@lo:502: 00000100:00100000:3.0:1788890864.756079:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.756092:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c850c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.756116:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996207744 00000100:00100000:2.0:1788890864.756120:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996207744 00000100:00100000:2.0:1788890864.756139:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788890864.756143:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996207744:12345-0@lo:502: 00000100:00100000:2.0:1788890864.756271:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996207744:12345-0@lo:502: Request processed in 127us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.756276:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788890864.756285:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207744:0@lo:502: 00000040:00080000:3.0:1788890864.756418:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788890864.756455:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788890864.756471:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788890864.756494:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788890864.756512:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788890864.756534:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788890864.756550:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788890864.756565:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788890864.756597:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788890864.756618:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788890864.756634:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788890864.756665:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788890864.756685:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788890864.756701:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788890864.756747:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788890864.756767:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788890864.756783:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788890864.756823:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788890864.756858:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788890864.756882:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788890864.756906:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788890864.756924:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788890864.756940:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788890864.756971:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788890864.756993:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788890864.757008:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788890864.757030:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788890864.757047:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788890864.757061:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207872:0@lo:502: 00000100:00100000:3.0:1788890864.757089:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.757112:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c850c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.757136:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996207872 00000100:00100000:2.0:1788890864.757147:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996207872 00000100:00100000:2.0:1788890864.757200:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788890864.757210:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996207872:12345-0@lo:502: 00000100:00100000:2.0:1788890864.757355:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996207872:12345-0@lo:502: Request processed in 147us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.757363:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788890864.757373:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996207872:0@lo:502: 00000040:00080000:3.0:1788890864.757418:0:6659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788890864.757428:0:6659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788890864.757662:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788890864.757674:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9da1fa4199b8) 00000020:00000080:3.0:1788890864.757687:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788890864.757753:0:6685:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da1f4e26000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788890864.757756:0:6685:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9da1f4e26000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788890864.757758:0:6685:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1f4e26000 3 00010000:00080000:3.0:1788890864.757783:0:6685:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da0c1181800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.118@tcp at head 00010000:00010000:2.0:1788890864.758258:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890864.759356:0:6685:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788890864.759498:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788890864.759521:0:6685:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788890864.759529:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9161b78f8ec3ec72 00000100:00080000:3.0:1788890864.759536:0:6685:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788890864.759541:0:6685:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9da0c1181800 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788890864.759568:0:6685:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f0263480 x1875787996208000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788890864.759593:0:6685:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788890864.759627:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1875787996208000:0@lo:38: 00000100:00100000:0.0:1788890864.759681:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.759709:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996208000 00000100:00100000:3.0:1788890864.759728:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996208000 00000100:00100000:3.0:1788890864.759762:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788890864.759769:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3278:x1875787996208000:12345-0@lo:38: 00010000:00080000:3.0:1788890864.759789:0:5815:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 88 last 0 00000020:00000080:3.0:1788890864.759823:0:5815:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9161b78f8ec3ec79 00000004:00100000:3.0:1788890864.759837:0:5815:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788890864.759871:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9da0c12a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788890864.759930:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875787996208000:12345-0@lo:38: Request processed in 158us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890864.759937:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788890864.759944:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f0263480 x1875787996208000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788890874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890864.759955:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788890864.759961:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788890864.759968:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788890864.759973:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788890864.759976:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da0c1181800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788890864.759982:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1875787996208000:0@lo:38: 00000040:00080000:0.0:1788890864.760037:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788890864.760082:0:6659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788890864.760112:0:6659:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788890864.760128:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890864.760138:0:6659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788890864.760201:0:6659:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788890864.760204:0:6659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788890864.760206:0:6659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890864.760208:0:6659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890864.760209:0:6659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890864.760211:0:6659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890864.760213:0:6659:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890864.760214:0:6659:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890864.760216:0:6659:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890864.760218:0:6659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890864.760220:0:6659:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788890864.760224:0:6659:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788890864.760226:0:6659:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788890864.760228:0:6659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788890864.760229:0:6659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890864.760230:0:6659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890864.760232:0:6659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890864.760233:0:6659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890864.760234:0:6659:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890864.760235:0:6659:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890864.760236:0:6659:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890864.760237:0:6659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890864.760238:0:6659:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788890864.760249:0:6659:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788890864.760258:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996208128:0@lo:253: 00000100:00100000:3.0:1788890864.760290:0:6659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890864.760315:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c850c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788890864.760324:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996208128 00000100:00100000:2.0:1788890864.760329:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996208128 00000100:00100000:2.0:1788890864.760357:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788890864.760369:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996208128:12345-0@lo:253: 20000000:01000000:2.0:1788890864.760395:0:5810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788890864.760408:0:5810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788890864.767164:0:5810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788890864.767191:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788890864.767201:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788890864.767207:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788890864.767228:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.767244:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788890864.767255:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000813853s 00010000:00010000:1.0:1788890864.767260:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.767267:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.767274:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.767281:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.767296:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c13f9800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788890864.767301:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.767309:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.767322:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.767329:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890864.767335:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ec80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890864.769089:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:6659:x1875787996208128:12345-0@lo:253: Request processed in 8721us (8793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890864.769097:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788890864.769109:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:6659:1875787996208128:0@lo:253: 10000000:01000000:3.0:1788890864.769131:0:6659:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788890864.769134:0:6659:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788890864.769136:0:6659:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788890864.769137:0:6659:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890864.769138:0:6659:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890864.769140:0:6659:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890864.769141:0:6659:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890864.769142:0:6659:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890864.769144:0:6659:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890864.769145:0:6659:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890864.769146:0:6659:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890864.769147:0:6659:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788890864.769160:0:6659:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788890864.771498:0:6659:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788890864.771623:0:6659:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788890864.771791:0:6659:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788890864.771897:0:6659:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788890864.772033:0:6659:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788890864.772197:0:6659:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788890864.772724:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788890864.841083:0:6659:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788890864.841090:0:6659:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788890864.841142:0:6659:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788890864.841208:0:6659:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788890864.841221:0:6659:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788890864.841239:0:6659:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:2.0:1788890865.782244:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788890865.782251:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1c9db0800 from 21 10000000:01000000:2.0:1788890865.782257:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788890865.782275:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890865.782295:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.782307:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.782330:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890865.782351:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996208256:0@lo:101: 00000100:00100000:2.0:1788890865.782407:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890865.782460:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996208256 00000100:00100000:1.0:1788890865.782468:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996208256 00000100:00100000:2.0:1788890865.782471:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.782531:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788890865.782542:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:5812:x1875787996208256:12345-0@lo:101: 00010000:00010000:1.0:1788890865.782554:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890865.782567:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ec87 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.782588:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec87 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.782599:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec87 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890865.782614:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c13f9400, rc 0) 00000100:00100000:1.0:1788890865.782657:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5812:x1875787996208256:12345-0@lo:101: Request processed in 117us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.782664:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788890865.782685:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996208256:0@lo:101: 00010000:00010000:2.0:1788890865.782713:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.782723:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890865.782769:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996208384:0@lo:501: 00000100:00100000:2.0:1788890865.782791:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.782817:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.782918:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996208384 00000100:00100000:0.0:1788890865.782922:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996208384 00000100:00100000:0.0:1788890865.782951:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788890865.782958:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5812:x1875787996208384:12345-0@lo:501: 00000100:00100000:0.0:1788890865.783377:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5812:x1875787996208384:12345-0@lo:501: Request processed in 415us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890865.783390:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788890865.783434:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996208384:0@lo:501: 00000100:00100000:2.0:1788890865.783463:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996208512:0@lo:503: 00000100:00100000:2.0:1788890865.783502:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.783528:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.783550:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996208512 00000100:00100000:1.0:1788890865.783556:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996208512 00000100:00100000:1.0:1788890865.783587:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788890865.783594:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5812:x1875787996208512:12345-0@lo:503: 00000100:00100000:1.0:1788890865.783862:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5812:x1875787996208512:12345-0@lo:503: Request processed in 269us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.783868:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788890865.783937:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996208512:0@lo:503: 00000100:00100000:2.0:1788890865.784159:0:6848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6848:1875787996208640:0@lo:502: 00000100:00100000:2.0:1788890865.784207:0:6848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.784233:0:6848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.784261:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996208640 00000100:00100000:0.0:1788890865.784266:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996208640 00000100:00100000:0.0:1788890865.784293:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788890865.784302:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:6848:x1875787996208640:12345-0@lo:502: 00000100:00100000:0.0:1788890865.784507:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:6848:x1875787996208640:12345-0@lo:502: Request processed in 206us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890865.784514:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788890865.784553:0:6848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6848:1875787996208640:0@lo:502: 00000100:00100000:2.0:1788890865.784589:0:6848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6848:1875787996208768:0@lo:502: 00000100:00100000:2.0:1788890865.784610:0:6848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.784623:0:6848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5221300 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.784647:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996208768 00000100:00100000:1.0:1788890865.784653:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996208768 00000100:00100000:1.0:1788890865.784681:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788890865.784686:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:6848:x1875787996208768:12345-0@lo:502: 00000100:00100000:1.0:1788890865.784828:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:6848:x1875787996208768:12345-0@lo:502: Request processed in 141us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.784835:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788890865.784903:0:6848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6848:1875787996208768:0@lo:502: 00000040:00080000:2.0:1788890865.784920:0:6848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788890865.784977:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788890865.785001:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788890865.785009:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.785016:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890865.785022:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788890865.785024:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9da1c9db0800 from 3 10000000:01000000:3.0:1788890865.785025:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788890865.785041:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.785053:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.785059:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890865.785066:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996208896:0@lo:101: 00000100:00100000:3.0:1788890865.785086:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.785100:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.785123:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996208896 00000100:00100000:0.0:1788890865.785129:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996208896 00000100:00100000:0.0:1788890865.785153:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788890865.785158:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5812:x1875787996208896:12345-0@lo:101: 00010000:00010000:0.0:1788890865.785164:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890865.785201:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ec95 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.785215:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec95 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.785221:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec95 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.785227:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031600, rc 0) 00000100:00100000:0.0:1788890865.785250:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996208896:12345-0@lo:101: Request processed in 93us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890865.785254:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788890865.785284:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996208896:0@lo:101: 00010000:00010000:3.0:1788890865.785294:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.785301:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890865.785343:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996209024:0@lo:256: 00000100:00100000:3.0:1788890865.785371:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.785395:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11840 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.785406:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996209024 00000100:00100000:1.0:1788890865.785411:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996209024 00000100:00100000:1.0:1788890865.785446:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788890865.785452:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996209024:12345-0@lo:256: 20000000:01000000:1.0:1788890865.785469:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788890865.785484:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788890865.785488:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788890865.785490:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:1.0:1788890865.785574:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996209024:12345-0@lo:256: Request processed in 121us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.785581:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788890865.785584:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996209024:0@lo:256: 10000000:01000000:3.0:1788890865.785618:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788890865.785621:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.785625:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890865.785636:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788890865.785637:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788890865.785638:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788890865.785650:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.785658:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.785665:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890865.785677:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996209152:0@lo:101: 00000100:00100000:3.0:1788890865.785716:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.785731:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.785756:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996209152 00000100:00100000:0.0:1788890865.785761:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996209152 00000100:00100000:0.0:1788890865.785795:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788890865.785801:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996209152:12345-0@lo:101: 00010000:00010000:0.0:1788890865.785808:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890865.785815:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3eca3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.785829:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3eca3 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.785838:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eca3 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.785845:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030800, rc 0) 00000100:00100000:0.0:1788890865.785876:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996209152:12345-0@lo:101: Request processed in 75us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890865.785883:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788890865.785952:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996209152:0@lo:101: 00010000:00010000:3.0:1788890865.785961:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.785969:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890865.786001:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996209280:0@lo:501: 00000100:00100000:3.0:1788890865.786021:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890865.786125:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996209280 00000100:00100000:3.0:1788890865.786129:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11840 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.786130:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996209280 00000100:00100000:1.0:1788890865.786162:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788890865.786516:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996209280:12345-0@lo:501: 00000100:00100000:1.0:1788890865.786729:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996209280:12345-0@lo:501: Request processed in 560us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.786738:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788890865.786755:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996209280:0@lo:501: 00000100:00100000:3.0:1788890865.786784:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996209408:0@lo:503: 00000100:00100000:3.0:1788890865.786823:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.786847:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.786864:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996209408 00000100:00100000:0.0:1788890865.786868:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996209408 00000100:00100000:0.0:1788890865.786893:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788890865.786899:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996209408:12345-0@lo:503: 00000100:00100000:0.0:1788890865.787107:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996209408:12345-0@lo:503: Request processed in 209us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890865.787112:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788890865.787139:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996209408:0@lo:503: 00000100:00100000:3.0:1788890865.787386:0:6849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6849:1875787996209536:0@lo:502: 00000100:00100000:3.0:1788890865.787418:0:6849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.787443:0:6849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.787455:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996209536 00000100:00100000:1.0:1788890865.787461:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996209536 00000100:00100000:1.0:1788890865.787492:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788890865.787499:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:6849:x1875787996209536:12345-0@lo:502: 00000100:00100000:1.0:1788890865.787653:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:6849:x1875787996209536:12345-0@lo:502: Request processed in 155us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.787658:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788890865.787679:0:6849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6849:1875787996209536:0@lo:502: 00000020:01000000:3.0:1788890865.787711:0:6849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788890865.787718:0:6849:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788890865.787724:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890865.787726:0:6849:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788890865.787731:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788890865.787734:0:6849:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.118@tcp to nid 0x20000c0a8cc76 (192.168.204.118@tcp) 00000020:01000000:3.0:1788890865.787753:0:6849:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788890865.787755:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788890865.787777:0:6849:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9da1cae599b8) 00000020:00000080:3.0:1788890865.787792:0:6849:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788890865.787799:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788890865.787865:0:6849:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788890865.787869:0:6849:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788890865.787873:0:6849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3ecb8 00010000:00080000:3.0:1788890865.787892:0:6849:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da1c5241000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.118@tcp at head 00010000:00010000:3.0:1788890865.788064:0:6849:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788890865.799239:0:6849:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788890865.799263:0:6849:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788890865.799771:0:6849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890865.799933:0:6849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788890865.799980:0:6849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788890865.800037:0:6849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788890865.800523:0:6850:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788890865.800528:0:6850:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788890865.800904:0:6849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788890865.800914:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788890865.800947:0:6849:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788890865.800972:0:6849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec3ecbf 00000100:00080000:3.0:1788890865.800981:0:6849:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788890865.800986:0:6849:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9da1c5241000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788890865.801018:0:6849:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f0263b80 x1875787996209664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788890865.801035:0:6849:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788890865.801086:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996209664:0@lo:8: 00000020:01000000:3.0:1788890865.801095:0:6849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890865.801101:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890865.801103:0:6849:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788890865.801108:0:6849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890865.801113:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890865.801115:0:6849:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788890865.801121:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788890865.801123:0:6849:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788890865.801135:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996209792:0@lo:400: 00000100:00100000:2.0:1788890865.801137:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996209920:0@lo:400: 00000100:00100000:3.0:1788890865.801152:0:6849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0260000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6849:1875787996210048:0@lo:502: 00000100:00100000:0.0:1788890865.801189:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890865.801206:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.801239:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996209664 00000100:00100000:2.0:1788890865.801242:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996209792 00000100:00100000:3.0:1788890865.801246:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996209664 00000100:00100000:2.0:1788890865.801248:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996209792 00000100:00100000:1.0:1788890865.801277:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.801294:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996209920 00000100:00100000:3.0:1788890865.801295:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890865.801298:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996209920 00000100:00100000:3.0:1788890865.801306:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3278:x1875787996209664:12345-0@lo:8: 00000100:00100000:0.0:1788890865.801325:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788890865.801330:0:6662:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 89 last 0 00000100:00080000:1.0:1788890865.801333:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890865.801339:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788890865.801339:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996209792:12345-0@lo:400: 00000100:00100000:2.0:1788890865.801350:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:00000080:3.0:1788890865.801362:0:6662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec3ecc6 00000100:00100000:2.0:1788890865.801373:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788890865.801385:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788890865.801393:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996209920:12345-0@lo:400: 00002000:00100000:3.0:1788890865.801397:0:6662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9da1c5245000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788890865.801405:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996209792:12345-0@lo:400: Request processed in 69us (203us total) trans 0 rc 0/0 00002000:00080000:3.0:1788890865.801406:0:6662:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788890865.801410:0:6662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788890865.801423:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890865.801442:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996209920:12345-0@lo:400: Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890865.801449:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788890865.801516:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1cae21880 x1875787996209920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00100000:3.0:1788890865.801517:0:6662:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788890865.801562:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996209920:0@lo:400: 00010000:00080000:1.0:1788890865.801601:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1cae22d80 x1875787996209792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890865.801609:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996209792:0@lo:400: 00002000:00080000:3.0:1788890865.801702:0:6662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788890865.801724:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9da1c5244000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788890865.801773:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875787996209664:12345-0@lo:8: Request processed in 468us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890865.801786:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890865.801829:0:6849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.801857:0:6849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890865.801915:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996210048 00000100:00100000:2.0:1788890865.801919:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996210048 00000100:00100000:2.0:1788890865.801948:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788890865.801955:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:6849:x1875787996210048:12345-0@lo:502: 00010000:00080000:0.0:1788890865.801983:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f0263b80 x1875787996209664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788890875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890865.801993:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788890865.801999:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788890865.802006:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788890865.802011:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788890865.802013:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1c5241000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788890865.802033:0:3278:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788890865.802040:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996209664:0@lo:8: 00000004:00080000:3.0:1788890865.802254:0:6850:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788890865.802421:0:6850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 89651251965ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788890865.802532:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:6849:x1875787996210048:12345-0@lo:502: Request processed in 576us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890865.802540:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788890865.803362:0:6849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0260000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6849:1875787996210048:0@lo:502: 00000020:01000000:3.0:1788890865.803629:0:6849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890865.803635:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890865.803638:0:6849:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788890865.803642:0:6849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788890865.804235:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788890865.804261:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788890865.804282:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.804293:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890865.804304:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788890865.804307:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1c9db0800 from 1 10000000:01000000:3.0:1788890865.804310:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788890865.804337:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.804345:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.804355:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890865.804381:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0260000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210176:0@lo:101: 00000100:00100000:3.0:1788890865.804436:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.804466:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996210176 00000100:00100000:3.0:1788890865.804468:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890865.804473:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996210176 00000100:00100000:2.0:1788890865.804513:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788890865.804522:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996210176:12345-0@lo:101: 00010000:00010000:2.0:1788890865.804532:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890865.804544:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3eccd expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.804566:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3eccd expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.804577:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eccd expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.804586:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29eee00, rc 0) 00000100:00100000:2.0:1788890865.804628:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996210176:12345-0@lo:101: Request processed in 107us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890865.804634:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788890865.804659:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0260000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210176:0@lo:101: 00010000:00010000:0.0:1788890865.804675:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.804685:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.804753:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210304:0@lo:501: 00000100:00100000:0.0:1788890865.804793:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.804812:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8bf3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890865.804819:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996210304 00000100:00100000:2.0:1788890865.804824:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996210304 00000100:00100000:2.0:1788890865.804846:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788890865.804853:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996210304:12345-0@lo:501: 00000100:00100000:2.0:1788890865.805010:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996210304:12345-0@lo:501: Request processed in 157us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890865.805017:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788890865.805041:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210304:0@lo:501: 00000100:00100000:0.0:1788890865.805069:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210432:0@lo:503: 00000100:00100000:0.0:1788890865.805103:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.805120:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8bf3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890865.805134:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996210432 00000100:00100000:2.0:1788890865.805139:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996210432 00000100:00100000:2.0:1788890865.805186:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788890865.805196:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996210432:12345-0@lo:503: 00000100:00100000:2.0:1788890865.805463:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996210432:12345-0@lo:503: Request processed in 269us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890865.805478:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788890865.805490:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210432:0@lo:503: 00000100:00100000:1.0:1788890865.805867:0:6853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6853:1875787996210560:0@lo:502: 00000100:00100000:1.0:1788890865.805925:0:6853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.805967:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996210560 00000100:00100000:1.0:1788890865.805970:0:6853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.805972:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996210560 00000100:00100000:0.0:1788890865.806004:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788890865.806014:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+15:6853:x1875787996210560:12345-0@lo:502: 00000100:00100000:0.0:1788890865.806272:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+15:6853:x1875787996210560:12345-0@lo:502: Request processed in 259us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890865.806280:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788890865.806295:0:6853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6853:1875787996210560:0@lo:502: 00000020:01000000:1.0:1788890865.806322:0:6853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890865.806332:0:6853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890865.806335:0:6853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788890865.806345:0:6853:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1c9db0800 00000020:00000080:1.0:1788890865.806351:0:6853:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788890865.806380:0:6853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6853:1875787996210688:0@lo:502: 00000100:00100000:1.0:1788890865.806416:0:6853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890865.806442:0:6853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890865.806778:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996210688 00000100:00100000:2.0:1788890865.806784:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996210688 00000100:00100000:2.0:1788890865.806813:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788890865.806822:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:6853:x1875787996210688:12345-0@lo:502: 00000100:00100000:2.0:1788890865.806959:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:6853:x1875787996210688:12345-0@lo:502: Request processed in 138us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890865.806968:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788890865.806986:0:6853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae22d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:6853:1875787996210688:0@lo:502: 00000020:01000000:1.0:1788890865.807013:0:6853:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890865.807018:0:6853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890865.807020:0:6853:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788890865.807024:0:6853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788890865.807109:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788890865.807135:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788890865.807145:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.807156:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890865.807164:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788890865.807190:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9da1f024b370 from 1 10000000:01000000:2.0:1788890865.807193:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788890865.807375:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.807384:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.807394:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890865.807408:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210816:0@lo:101: 00000100:00100000:2.0:1788890865.807464:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.807582:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf600 going to sleep for 11 seconds 00000100:00100000:2.0:1788890865.807593:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996210816 00000100:00100000:2.0:1788890865.807598:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996210816 00000100:00100000:2.0:1788890865.807626:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788890865.807635:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996210816:12345-0@lo:101: 00010000:00010000:2.0:1788890865.807643:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890865.807654:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ecdb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.807673:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ecdb expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.807683:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ecdb expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890865.807706:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29efe00, rc 0) 00000100:00100000:2.0:1788890865.807748:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996210816:12345-0@lo:101: Request processed in 113us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890865.807756:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788890865.807764:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210816:0@lo:101: 00010000:00010000:0.0:1788890865.807780:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890865.807790:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890865.807837:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210944:0@lo:501: 00000100:00100000:0.0:1788890865.807863:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.807892:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5221300 going to sleep for 11 seconds 00000100:00100000:2.0:1788890865.807935:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996210944 00000100:00100000:2.0:1788890865.807940:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996210944 00000100:00100000:2.0:1788890865.807983:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788890865.807992:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996210944:12345-0@lo:501: 00000100:00100000:2.0:1788890865.808196:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996210944:12345-0@lo:501: Request processed in 175us (300us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788890865.808204:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788890865.808326:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996210944:0@lo:501: 10000000:01000000:3.0:1788890865.808351:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788890865.808358:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890865.808366:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788890865.815674:0:6851:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788890865.815711:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996211072:0@lo:13: 00000100:00100000:3.0:1788890865.815724:0:6851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0260a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1875787996211200:0@lo:7: 00000100:00100000:3.0:1788890865.815806:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890865.815807:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890865.815842:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996211072 00000100:00100000:1.0:1788890865.815850:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996211072 00000100:00100000:3.0:1788890865.815870:0:6851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11840 going to sleep for 11 seconds 00000100:00100000:1.0:1788890865.815917:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788890865.815928:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875787996211072:12345-0@lo:13: 00002000:00000024:1.0:1788890865.815960:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1788890865.816017:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875787996211072:12345-0@lo:13: Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.816027:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788890865.816049:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f0261180 x1875787996211072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890865.816070:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996211072:0@lo:13: 00000100:00100000:1.0:1788890865.816076:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996211200 00000100:00100000:1.0:1788890865.816082:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996211200 00000100:00100000:1.0:1788890865.816114:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788890865.816122:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6851:x1875787996211200:12345-0@lo:7: 00000100:00080000:1.0:1788890865.816583:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788890865.823387:0:6664:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788890865.823393:0:6664:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788890865.823494:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6851:x1875787996211200:12345-0@lo:7: Request processed in 7367us (7691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890865.823504:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788890865.823564:0:6851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f0260a80 x1875787996211200/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788890881 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890865.823579:0:6851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0260a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1875787996211200:0@lo:7: 00000004:00080000:3.0:1788890865.823595:0:6851:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788890865.823637:0:6851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0260a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1875787996211328:0@lo:5: 00000100:00100000:3.0:1788890865.823686:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.823771:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996211328 00000100:00100000:0.0:1788890865.823779:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996211328 00000100:00100000:0.0:1788890865.823821:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788890865.823823:0:6851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.823832:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6851:x1875787996211328:12345-0@lo:5: 00002000:00080000:0.0:1788890865.823857:0:6663:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788890865.823860:0:6663:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788890865.824080:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6851:x1875787996211328:12345-0@lo:5: Request processed in 250us (394us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788890865.824087:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788890865.824110:0:6851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f0260a80 x1875787996211328/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890881 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890865.824124:0:6851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0260a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1875787996211328:0@lo:5: 00000004:00080000:3.0:1788890865.824134:0:6851:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788890865.824159:0:6851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1875787996211456:0@lo:700: 00000100:00100000:3.0:1788890865.824233:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890865.824268:0:6851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cae11840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.824273:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996211456 00000100:00100000:0.0:1788890865.824297:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996211456 00000100:00100000:0.0:1788890865.824340:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788890865.824348:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6851:x1875787996211456:12345-0@lo:700: 00000100:00100000:0.0:1788890865.824387:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6670:1875787996211584:0@lo:700: 00000100:00100000:0.0:1788890865.824418:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.824436:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41f0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788890865.824460:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996211584 00000100:00100000:3.0:1788890865.824465:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996211584 00000100:00100000:3.0:1788890865.824513:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788890865.824522:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6670:x1875787996211584:12345-0@lo:700: 00000004:00080000:1.0:1788890865.827647:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1788890865.837396:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788890865.840454:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6670:x1875787996211584:12345-0@lo:700: Request processed in 15928us (16028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890865.840473:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788890865.840521:0:6670:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da2018fdc00 x1875787996211584/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788890881 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890865.840539:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6670:1875787996211584:0@lo:700: 40000000:02000000:3.0:1788890865.840555:0:6670:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1788890865.868704:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788890865.868732:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788890865.868776:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6851:x1875787996211456:12345-0@lo:700: Request processed in 44424us (44536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890865.868787:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788890865.868798:0:6851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f0261500 x1875787996211456/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788890881 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890865.868814:0:6851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1875787996211456:0@lo:700: 00000004:02000040:1.0:1788890865.883407:0:6851:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788890865.886090:0:6851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1875787996211712:0@lo:5: 00000100:00100000:1.0:1788890865.886146:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890865.886204:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996211712 00000100:00100000:0.0:1788890865.886211:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996211712 00000100:00100000:1.0:1788890865.886234:0:6851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890865.886263:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788890865.886273:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6851:x1875787996211712:12345-0@lo:5: 00002000:00080000:0.0:1788890865.889906:0:6664:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788890865.889933:0:6664:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788890865.891875:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6851:x1875787996211712:12345-0@lo:5: Request processed in 5601us (5726us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788890865.891882:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788890865.891921:0:6851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1cae22d80 x1875787996211712/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890881 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890865.891935:0:6851:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788890865.891948:0:6851:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9da1cae22d80 x1875787996211712/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890881 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890865.891970:0:6851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6851:1875787996211712:0@lo:5: 00000004:00080000:1.0:1788890865.891982:0:6851:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788890866.807345:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890866.827474:0:7035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788890867.830546:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890868.854447:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788890869.411476:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788890869.880272:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890870.839001:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890870.839026:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996211840:0@lo:13: 00000100:00100000:0.0:1788890870.839115:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890870.839276:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996211840 00000100:00100000:2.0:1788890870.839319:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996211840 00000100:00100000:2.0:1788890870.839383:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788890870.839394:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996211840:12345-0@lo:13: 00000100:00080000:0.0:1788890870.839431:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788890870.839439:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788890870.839587:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996211840:12345-0@lo:13: Request processed in 194us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890870.839605:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788890870.839667:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da2018ff100 x1875787996211840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890870.839682:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788890870.839712:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996211840:0@lo:13: 00000100:00100000:2.0:1788890870.839885:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996211968:0@lo:400: 00000100:00100000:0.0:1788890870.839899:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996212224:0@lo:400: 00000100:00100000:2.0:1788890870.839927:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890870.839962:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890870.840014:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996212096:0@lo:400: 00000100:00100000:0.0:1788890870.840015:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996212224 00000100:00100000:0.0:1788890870.840021:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996212224 00000100:00100000:1.0:1788890870.840050:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890870.840079:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996212096 00000100:00100000:0.0:1788890870.840084:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996212096 00000100:00100000:0.0:1788890870.840121:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890870.840128:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788890870.840135:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996212224:12345-0@lo:400: 00000100:00100000:1.0:1788890870.840139:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996212096:12345-0@lo:400: 00000100:00100000:1.0:1788890870.840196:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996212096:12345-0@lo:400: Request processed in 62us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890870.840202:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788890870.840227:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f0261c00 x1875787996212096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890870.840238:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996212096:0@lo:400: 00000100:00100000:0.0:1788890870.840313:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996212224:12345-0@lo:400: Request processed in 183us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890870.840323:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788890870.840326:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f0260380 x1875787996212224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890870.840351:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996212224:0@lo:400: 00000100:00080000:0.0:1788890870.840353:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890870.840496:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996211968 00000100:00100000:2.0:1788890870.840501:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996211968 00000100:00100000:2.0:1788890870.840526:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788890870.840534:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:3279:x1875787996211968:12345-0@lo:400: 00000100:00100000:2.0:1788890870.840703:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:3279:x1875787996211968:12345-0@lo:400: Request processed in 170us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890870.840710:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788890870.841461:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996211968:0@lo:400: 00010000:00010000:2.0:1788890870.902337:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890871.926325:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890872.951939:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788890873.275462:0:7607:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788890873.275470:0:7607:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788890873.275637:0:7607:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9da1c5240800 00000020:01000004:2.0:1788890873.275655:0:7607:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788890873.275670:0:7607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788890873.275693:0:7607:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9da201c63370) 00000020:00000080:2.0:1788890873.275710:0:7607:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788890873.288498:0:7607:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788890873.288793:0:7607:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788890873.304683:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788890873.311973:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788890873.312004:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788890873.312054:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788890873.312076:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788890873.312399:0:7607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788890873.312410:0:7607:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788890873.312418:0:7607:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9161b78f8ec3ecf0 00000020:01000004:2.0:1788890873.312425:0:7607:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788890873.312442:0:7607:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788890873.312445:0:7607:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788890873.312450:0:7607:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788890873.312475:0:7607:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788890873.312479:0:7607:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788890873.325735:0:7607:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788890873.325771:0:7607:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.118@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788890873.325775:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788890873.325777:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788890873.325778:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890873.325779:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890873.325780:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890873.325782:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890873.325783:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890873.325785:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890873.325786:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890873.325788:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890873.325789:0:7607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788890873.325796:0:7607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788890873.325798:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788890873.325799:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788890873.325800:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890873.325801:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788890873.325802:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890873.325803:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890873.325804:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890873.325805:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788890873.325806:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788890873.325807:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890873.325808:0:7607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788890873.325839:0:7607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788890873.325855:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996212352:0@lo:253: 00000100:00100000:3.0:1788890873.325982:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890873.326067:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681000 going to sleep for 11 seconds 00000100:00100000:2.0:1788890873.326119:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996212352 00000100:00100000:2.0:1788890873.326127:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996212352 00000100:00100000:2.0:1788890873.326265:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788890873.326275:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:7607:x1875787996212352:12345-0@lo:253: 20000000:01000000:2.0:1788890873.326305:0:5808:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788890873.326309:0:5808:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788890873.326314:0:5808:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788890873.326323:0:5808:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788890873.327216:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788890873.327393:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788890873.327406:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788890873.327438:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788890873.327444:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788890873.327467:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788890873.327503:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788890873.327854:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788890873.327872:0:5808:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.118@tcp 20000000:01000000:2.0:1788890873.327874:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.118@tcp (null) (null) (null) 00000040:00080000:2.0:1788890873.327975:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788890873.327983:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788890873.328027:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788890873.328034:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.118@tcp (null) (null) 00000040:00080000:2.0:1788890873.328059:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788890873.328066:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788890873.328090:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788890873.328133:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788890873.328902:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788890873.329118:0:5808:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.118@tcp 20000000:01000000:2.0:1788890873.329120:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.118@tcp (null) (null) (null) 00000040:00080000:2.0:1788890873.329158:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788890873.329165:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788890873.329274:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788890873.329281:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.118@tcp (null) (null) 00000040:00080000:2.0:1788890873.329305:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788890873.329312:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788890873.329350:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788890873.329379:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788890873.329392:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788890873.329400:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788890873.329405:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788890873.329407:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788890873.329409:0:5808:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788890873.329419:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788890873.329422:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788890873.329451:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788890873.329454:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788890873.329904:0:7609:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788890873.330003:0:7609:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788890873.330048:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788890873.330415:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788890873.330449:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788890873.330476:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788890873.330485:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788890873.330487:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788890873.330760:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788890873.330995:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788890873.331026:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788890873.331071:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788890873.331080:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788890873.331082:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788890873.331478:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788890873.331515:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788890873.331584:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788890873.331765:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788890873.331795:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788890873.331836:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788890873.331846:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788890873.331848:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788890873.332428:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788890873.332486:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788890873.332511:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788890873.332755:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788890873.332794:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788890873.332844:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788890873.332860:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788890873.332878:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.332894:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ec3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec33 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.332903:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec5d expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.332984:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec87 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.332992:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eca3 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.332999:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ecdb expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.333006:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.333045:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ecdb expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.333060:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ecdb expref: 16 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890873.333074:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d46680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996212480:0@lo:104: 00000100:00100000:2.0:1788890873.333137:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788890873.333344:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3eca3 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.333353:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3eca3 expref: 16 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890873.333361:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d47800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996212608:0@lo:104: 00000100:00100000:2.0:1788890873.333384:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890873.333405:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996212480 00000100:00100000:0.0:1788890873.333411:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996212480 00000100:00100000:0.0:1788890873.333481:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788890873.333490:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5808:x1875787996212480:12345-0@lo:104: 00010000:00010000:0.0:1788890873.333502:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.333560:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788890873.333565:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5808:x1875787996212480:12345-0@lo:104: Request processed in 78us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.333572:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788890873.333613:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788890873.333619:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.333627:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c29eec00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:1.0:1788890873.333631:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.333639:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788890873.333646:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890873.333652:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788890873.333677:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.333683:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788890873.333698:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.333704:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c29eec00/0x9161b78f8ec3ecdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ece2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.333715:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890873.333716:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890873.333718:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890873.333734:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996212736:0@lo:103: 00000100:00100000:1.0:1788890873.333764:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.333795:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996212736 00000100:00100000:1.0:1788890873.333798:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996212736 00010000:00010000:1.0:1788890873.333811:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ecdb expref: 17 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890873.333831:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890873.333837:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d14b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:3282:x1875787996212736:12345-0@lo:103: 00010000:00010000:1.0:1788890873.333845:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890873.333850:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ecdb expref: 17 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.333860:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ecdb expref: 17 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.333873:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890873.333897:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d14b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:3282:x1875787996212736:12345-0@lo:103: Request processed in 60us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890873.333903:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890873.334045:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996212736:0@lo:103: 00010000:00010000:2.0:1788890873.334316:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ec87 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.334330:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec87 expref: 16 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890873.334339:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d44700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996212864:0@lo:104: 00010000:00010000:2.0:1788890873.334361:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ec5d expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.334368:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec5d expref: 16 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890873.334375:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996212992:0@lo:104: 00010000:00010000:2.0:1788890873.334390:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ec3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ec33 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.334397:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ec3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec33 expref: 16 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890873.334404:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d47480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996213120:0@lo:104: 00000100:00100000:2.0:1788890873.334416:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8ba4780 going to sleep for 11 seconds 00010000:00010000:2.0:1788890873.334425:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ece2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ecdb expref: 16 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890873.334434:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d46680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996212480:0@lo:104: 00000100:00100000:3.0:1788890873.334587:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788890873.334603:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890873.334646:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890873.334706:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890873.334718:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1788890873.334722:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996212608 00000100:00100000:0.0:1788890873.334725:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996212608 00000100:00100000:0.0:1788890873.334741:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996212864 00000100:00100000:0.0:1788890873.334743:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996212864 00000100:00100000:0.0:1788890873.334750:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996212992 00000100:00100000:0.0:1788890873.334752:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996212992 00000100:00100000:0.0:1788890873.334760:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890873.334766:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1caea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+5:5808:x1875787996212608:12345-0@lo:104: 00010000:00010000:0.0:1788890873.334774:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.334812:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788890873.334817:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1caea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+5:5808:x1875787996212608:12345-0@lo:104: Request processed in 51us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.334823:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890873.334851:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890873.334856:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0263800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+4:5808:x1875787996212864:12345-0@lo:104: 00010000:00010000:0.0:1788890873.334862:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.334887:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890873.334892:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0263800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+4:5808:x1875787996212864:12345-0@lo:104: Request processed in 36us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.334897:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890873.334963:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788890873.334971:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5808:x1875787996212992:12345-0@lo:104: 00010000:00010000:0.0:1788890873.334978:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335010:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788890873.335014:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5808:x1875787996212992:12345-0@lo:104: Request processed in 45us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.335020:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788890873.335048:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788890873.335053:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335061:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da202179400 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890873.335064:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335072:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890873.335079:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890873.335084:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890873.335102:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335108:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890873.335120:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335126:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3eca3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ecaa expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335145:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788890873.335147:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335153:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c29ef600 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890873.335156:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335162:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890873.335183:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890873.335188:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890873.335199:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335204:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890873.335209:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335215:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c29ef600/0x9161b78f8ec3ec87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335223:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890873.335226:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335239:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c13f8e00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890873.335242:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335248:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890873.335254:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890873.335259:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890873.335268:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335273:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890873.335282:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335288:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c13f8e00/0x9161b78f8ec3ec5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec64 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335297:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890873.335298:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890873.335299:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890873.335316:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996213376:0@lo:103: 00000100:00100000:0.0:1788890873.335338:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890873.335354:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890873.335358:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996213248:0@lo:103: 00000100:00100000:0.0:1788890873.335381:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890873.335411:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996213504:0@lo:103: 00000100:00100000:0.0:1788890873.335429:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890873.335450:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996213376 00000100:00100000:0.0:1788890873.335453:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996213376 00010000:00010000:0.0:1788890873.335465:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec87 expref: 16 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890873.335479:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996213248 00000100:00100000:0.0:1788890873.335482:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996213248 00010000:00010000:0.0:1788890873.335489:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eca3 expref: 17 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890873.335498:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996213504 00000100:00100000:0.0:1788890873.335499:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996213504 00010000:00010000:0.0:1788890873.335506:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec5d expref: 18 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890873.335516:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890873.335521:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:3280:x1875787996213376:12345-0@lo:103: 00010000:00010000:0.0:1788890873.335528:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890873.335532:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec87 expref: 18 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335540:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec87 expref: 18 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335564:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890873.335585:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:3280:x1875787996213376:12345-0@lo:103: Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.335598:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890873.335609:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890873.335614:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:3280:x1875787996213248:12345-0@lo:103: 00010000:00010000:0.0:1788890873.335620:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890873.335624:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eca3 expref: 17 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335632:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3eca3 expref: 17 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335641:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890873.335656:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:3280:x1875787996213248:12345-0@lo:103: Request processed in 43us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.335661:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890873.335670:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788890873.335674:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:3281:x1875787996213504:12345-0@lo:103: 00010000:00010000:0.0:1788890873.335680:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890873.335683:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec5d expref: 16 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335691:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec5d expref: 16 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.335699:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890873.335715:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:3281:x1875787996213504:12345-0@lo:103: Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.335721:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788890873.335740:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996213504:0@lo:103: 00000100:00100000:0.0:1788890873.335761:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996213248:0@lo:103: 00000100:00100000:0.0:1788890873.335767:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996213376:0@lo:103: 00010000:00010000:0.0:1788890873.335795:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890873.335801:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890873.335813:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ecaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3eca3 expref: 15 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890873.335822:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d47800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996212608:0@lo:104: 00010000:00010000:0.0:1788890873.335830:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c13f9400/0x9161b78f8ec3ec8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ec87 expref: 14 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890873.335837:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d44700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996212864:0@lo:104: 00010000:00010000:0.0:1788890873.335844:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ec64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ec5d expref: 13 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890873.335851:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996212992:0@lo:104: 00000100:00100000:1.0:1788890873.336004:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1788890873.336071:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996213120 00000100:00100000:3.0:1788890873.336075:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996213120 00000100:00100000:3.0:1788890873.336124:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890873.336131:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5808:x1875787996213120:12345-0@lo:104: 00010000:00010000:3.0:1788890873.336139:0:6677:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ec33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336226:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788890873.336231:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5808:x1875787996213120:12345-0@lo:104: Request processed in 102us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890873.336237:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788890873.336318:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d47480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1875787996213120:0@lo:104: 00010000:00010000:2.0:1788890873.336341:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336381:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890873.336385:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ec33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336396:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c13f9c00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:3.0:1788890873.336399:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ec33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336406:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ec33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788890873.336413:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ec33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890873.336418:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788890873.336468:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ec33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336474:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788890873.336504:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996213632:0@lo:103: 00000100:00100000:2.0:1788890873.336528:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788890873.336598:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ec33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336604:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ec33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec3a expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336617:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890873.336619:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890873.336620:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890873.336637:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996213632 00000100:00100000:3.0:1788890873.336640:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996213632 00010000:00010000:3.0:1788890873.336654:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ec3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec33 expref: 13 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890873.336671:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890873.336684:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:3282:x1875787996213632:12345-0@lo:103: 00010000:00010000:3.0:1788890873.336692:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890873.336697:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ec3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec33 expref: 13 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336705:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ec3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec33 expref: 13 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336715:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ec3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ec33 expref: 13 pid: 5808 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336727:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336734:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336746:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336753:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336758:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336764:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336769:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c29ee800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890873.336772:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336783:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336795:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.336803:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890873.336968:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:3282:x1875787996213632:12345-0@lo:103: Request processed in 284us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890873.336975:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788890873.336998:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.337006:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.337012:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ecf7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788890873.337025:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788890873.344650:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996213632:0@lo:103: 00000100:00100000:2.0:1788890873.364740:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+11:7607:x1875787996212352:12345-0@lo:253: Request processed in 38459us (38750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.364754:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788890873.364853:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996212352:0@lo:253: 10000000:01000000:3.0:1788890873.364867:0:7607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788890873.364871:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788890873.364872:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788890873.364874:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788890873.364875:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788890873.364876:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788890873.364878:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788890873.364879:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788890873.364880:0:7607:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788890873.364882:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788890873.364898:0:7607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788890873.364929:0:7607:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9da1c5240800 from lustre-OST0001 10000000:01000000:3.0:1788890873.364951:0:7607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788890873.364954:0:7607:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788890873.364960:0:7607:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9da1f024b370 local copy 10000000:01000000:3.0:1788890873.364964:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788890873.364995:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.365006:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.365016:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890873.365031:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996213760:0@lo:101: 00000100:00100000:3.0:1788890873.365061:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890873.365111:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890873.365213:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996213760 00000100:00100000:2.0:1788890873.365219:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996213760 00000100:00100000:2.0:1788890873.365249:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788890873.365257:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+11:7607:x1875787996213760:12345-0@lo:101: 00010000:00010000:2.0:1788890873.365268:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890873.365280:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ecfe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.365300:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ecfe expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.365310:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ecfe expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.365319:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29efe00, rc 0) 00000100:00100000:2.0:1788890873.365350:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:7607:x1875787996213760:12345-0@lo:101: Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.365356:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788890873.365450:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996213760:0@lo:101: 00010000:00010000:3.0:1788890873.365461:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.365470:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890873.365572:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996213888:0@lo:501: 00000100:00100000:3.0:1788890873.365594:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890873.365617:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890873.365659:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996213888 00000100:00100000:2.0:1788890873.365662:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996213888 00000100:00100000:2.0:1788890873.365694:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788890873.365699:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:7607:x1875787996213888:12345-0@lo:501: 00000100:00100000:2.0:1788890873.365870:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+12:7607:x1875787996213888:12345-0@lo:501: Request processed in 170us (274us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788890873.365876:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788890873.365989:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996213888:0@lo:501: 10000000:01000000:1.0:1788890873.366002:0:7607:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788890873.366027:0:7607:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788890873.366032:0:7607:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.366041:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.366054:0:7607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.366069:0:7607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788890873.366087:0:7607:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9da1c5240800 10000000:01000000:1.0:1788890873.366091:0:7607:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788890873.366095:0:7607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788890873.366098:0:7607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788890873.366102:0:7607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788890873.366104:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788890873.366120:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.366127:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.366134:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890873.366146:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214016:0@lo:101: 00000100:00100000:1.0:1788890873.366193:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.366212:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201a06a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890873.366226:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996214016 00000100:00100000:1.0:1788890873.366229:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996214016 00000100:00100000:1.0:1788890873.366249:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788890873.366254:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+12:7607:x1875787996214016:12345-0@lo:101: 00010000:00010000:1.0:1788890873.366260:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890873.366268:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ed0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.366287:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed0c expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.366295:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed0c expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.366303:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c13f8800, rc 0) 00000100:00100000:1.0:1788890873.366326:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214016:12345-0@lo:101: Request processed in 72us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890873.366332:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788890873.366356:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214016:0@lo:101: 00010000:00010000:1.0:1788890873.366365:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.366372:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890873.366416:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214144:0@lo:501: 00000100:00100000:1.0:1788890873.366435:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.366445:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201a06a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890873.366455:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996214144 00000100:00100000:1.0:1788890873.366458:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996214144 00000100:00100000:1.0:1788890873.366471:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788890873.366476:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214144:12345-0@lo:501: 00000100:00100000:1.0:1788890873.366613:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214144:12345-0@lo:501: Request processed in 136us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890873.366619:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788890873.366647:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214144:0@lo:501: 00000100:00100000:1.0:1788890873.366667:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214272:0@lo:503: 00000100:00100000:1.0:1788890873.366695:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.366705:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201a06a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890873.366714:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996214272 00000100:00100000:1.0:1788890873.366717:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996214272 00000100:00100000:1.0:1788890873.366731:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788890873.366735:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214272:12345-0@lo:503: 00000100:00100000:1.0:1788890873.366850:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214272:12345-0@lo:503: Request processed in 113us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890873.366856:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788890873.366890:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214272:0@lo:503: 00000040:00080000:1.0:1788890873.367250:0:7607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788890873.367306:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214400:0@lo:502: 00000100:00100000:1.0:1788890873.367338:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.367362:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201a06a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890873.367376:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996214400 00000100:00100000:1.0:1788890873.367380:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996214400 00000100:00100000:1.0:1788890873.367396:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788890873.367401:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214400:12345-0@lo:502: 00000100:00100000:1.0:1788890873.367524:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214400:12345-0@lo:502: Request processed in 122us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890873.367530:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788890873.367578:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214400:0@lo:502: 00000040:00080000:1.0:1788890873.367795:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788890873.367837:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788890873.367882:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788890873.368138:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788890873.368248:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788890873.368286:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788890873.368311:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214528:0@lo:502: 00000100:00100000:1.0:1788890873.368346:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.368416:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201a06a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788890873.368500:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890873.368508:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.368517:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da202178e00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890873.368522:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.368532:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890873.368539:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890873.368564:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890873.368584:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.368590:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890873.368617:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.368624:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da202178e00/0x9161b78f8ec3ecfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9161b78f8ec3ed05 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.368637:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890873.368638:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890873.368640:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890873.368683:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788890873.368694:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996214656:0@lo:103: 00000100:00100000:3.0:1788890873.368730:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890873.368835:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996214656 00000100:00100000:0.0:1788890873.368841:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996214656 00000100:00100000:0.0:1788890873.368885:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890873.368893:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:3280:x1875787996214656:12345-0@lo:103: 00010000:00010000:0.0:1788890873.368904:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890873.369013:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ecfe expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890873.369025:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890873.369059:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+12:3280:x1875787996214656:12345-0@lo:103: Request processed in 167us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.369066:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788890873.369123:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996214656:0@lo:103: 00000100:00100000:2.0:1788890873.369163:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996214528 00000100:00100000:2.0:1788890873.369265:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996214528 00000100:00100000:2.0:1788890873.369290:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788890873.369296:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+12:7607:x1875787996214528:12345-0@lo:502: 00000100:00100000:2.0:1788890873.369464:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+12:7607:x1875787996214528:12345-0@lo:502: Request processed in 168us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.369470:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788890873.369576:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214528:0@lo:502: 00000040:00080000:1.0:1788890873.369676:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788890873.369689:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788890873.370233:0:7613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788890873.370241:0:7613:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788890873.370247:0:7613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890873.370249:0:7613:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788890873.370254:0:7613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788890873.370277:0:7613:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9da1c5264d28) 00000020:00000080:1.0:1788890873.370301:0:7613:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788890873.370306:0:7613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788890873.370375:0:7613:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da1c5240800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788890873.370383:0:7613:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788890873.370389:0:7613:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9161b78f8ec3ed21 00010000:00010000:1.0:1788890873.373769:0:7613:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788890873.374113:0:7613:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788890873.376464:0:7613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788890873.376738:0:7613:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788890873.380681:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788890873.381306:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788890873.382678:0:7613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788890873.382688:0:7613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890873.382694:0:7613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890873.382696:0:7613:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788890873.382702:0:7613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890873.382705:0:7613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890873.382706:0:7613:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788890873.382709:0:7613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788890873.382711:0:7613:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788890873.382757:0:7613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890873.382760:0:7613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890873.382762:0:7613:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788890873.382764:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788890873.390023:0:7607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788890873.390062:0:7607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788890873.390081:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.390093:0:7607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890873.390101:0:7607:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1c5240800 from 1 10000000:01000000:3.0:1788890873.390105:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788890873.390142:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.390150:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.390160:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890873.390196:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214784:0@lo:101: 00000100:00100000:3.0:1788890873.390259:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890873.390309:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c56816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890873.390343:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996214784 00000100:00100000:3.0:1788890873.390350:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996214784 00000100:00100000:3.0:1788890873.390396:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788890873.390406:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:7607:x1875787996214784:12345-0@lo:101: 00010000:00010000:3.0:1788890873.390419:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890873.390438:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ed28 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.390459:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed28 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.390470:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed28 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.390479:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da202178e00, rc 0) 00000100:00100000:3.0:1788890873.390515:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214784:12345-0@lo:101: Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890873.390521:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788890873.390579:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214784:0@lo:101: 00010000:00010000:3.0:1788890873.390592:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.390602:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890873.390693:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214912:0@lo:501: 00000100:00100000:3.0:1788890873.390717:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890873.390733:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c56816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890873.390747:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996214912 00000100:00100000:3.0:1788890873.390751:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996214912 00000100:00100000:3.0:1788890873.390771:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788890873.390777:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214912:12345-0@lo:501: 00000100:00100000:3.0:1788890873.391314:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996214912:12345-0@lo:501: Request processed in 536us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890873.391330:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788890873.391410:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996214912:0@lo:501: 00000100:00100000:0.0:1788890873.391440:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215040:0@lo:503: 00000100:00100000:0.0:1788890873.391482:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890873.391555:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8522300 going to sleep for 11 seconds 00000100:00100000:1.0:1788890873.392636:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996215040 00000100:00100000:1.0:1788890873.392643:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996215040 00000100:00100000:1.0:1788890873.392716:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788890873.392724:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996215040:12345-0@lo:503: 00000100:00100000:1.0:1788890873.393060:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996215040:12345-0@lo:503: Request processed in 336us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890873.393073:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788890873.393130:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215040:0@lo:503: 00000040:00080000:0.0:1788890873.393517:0:7607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788890873.393592:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215168:0@lo:502: 00000100:00100000:0.0:1788890873.393630:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890873.393703:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8522300 going to sleep for 11 seconds 00000100:00100000:3.0:1788890873.393735:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996215168 00000100:00100000:3.0:1788890873.393739:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996215168 00000100:00100000:3.0:1788890873.393799:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788890873.393807:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996215168:12345-0@lo:502: 00000100:00100000:3.0:1788890873.394053:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996215168:12345-0@lo:502: Request processed in 247us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890873.394060:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788890873.394135:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215168:0@lo:502: 00000040:00080000:1.0:1788890873.394427:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788890873.394474:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788890873.394496:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215296:0@lo:502: 00000100:00100000:1.0:1788890873.394529:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.394594:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788890873.394651:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996215296 00000100:00100000:3.0:1788890873.394656:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996215296 00000100:00100000:3.0:1788890873.394716:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788890873.394724:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996215296:12345-0@lo:502: 00000100:00100000:3.0:1788890873.394830:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996215296:12345-0@lo:502: Request processed in 107us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890873.394836:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788890873.394920:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215296:0@lo:502: 00000040:00080000:1.0:1788890873.394989:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788890873.394998:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788890873.395525:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890873.395533:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890873.395535:0:7617:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788890873.395563:0:7617:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1c5240800 00000020:00000080:2.0:1788890873.395566:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788890873.395586:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890873.395588:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890873.395589:0:7617:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788890873.395592:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788890873.395708:0:7607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788890873.395730:0:7607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890873.395750:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.395760:0:7607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890873.395797:0:7607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788890873.395800:0:7607:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9da1c5240800 10000000:01000000:1.0:1788890873.395803:0:7607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9da1c5240800 10000000:01000000:1.0:1788890873.395808:0:7607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788890873.395813:0:7607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1c5240800 from 1 10000000:01000000:1.0:1788890873.395815:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890873.395841:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.395849:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.395863:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890873.395878:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215424:0@lo:101: 00000100:00100000:1.0:1788890873.395928:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.395953:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890873.396052:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996215424 00000100:00100000:2.0:1788890873.396057:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996215424 00000100:00100000:2.0:1788890873.396083:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788890873.396092:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996215424:12345-0@lo:101: 00010000:00010000:2.0:1788890873.396102:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890873.396115:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ed36 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.396137:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed36 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.396147:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed36 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.396157:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29efe00, rc 0) 00000100:00100000:2.0:1788890873.396222:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996215424:12345-0@lo:101: Request processed in 131us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.396228:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788890873.396311:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215424:0@lo:101: 00010000:00010000:1.0:1788890873.396325:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.396334:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890873.396429:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215552:0@lo:501: 00000100:00100000:1.0:1788890873.396454:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.396482:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890873.396522:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996215552 00000100:00100000:2.0:1788890873.396526:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996215552 00000100:00100000:2.0:1788890873.396555:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788890873.396562:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996215552:12345-0@lo:501: 00000100:00100000:2.0:1788890873.396801:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996215552:12345-0@lo:501: Request processed in 239us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.396816:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788890873.396882:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215552:0@lo:501: 00000100:00100000:1.0:1788890873.396919:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215680:0@lo:503: 00000100:00100000:1.0:1788890873.396956:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.396978:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890873.397073:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996215680 00000100:00100000:2.0:1788890873.397078:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996215680 00000100:00100000:2.0:1788890873.397095:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788890873.397101:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996215680:12345-0@lo:503: 00000100:00100000:2.0:1788890873.397264:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996215680:12345-0@lo:503: Request processed in 162us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.397270:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788890873.397431:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215680:0@lo:503: 00000040:00080000:1.0:1788890873.397733:0:7607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788890873.397785:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215808:0@lo:502: 00000100:00100000:1.0:1788890873.397824:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.397923:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890873.398049:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996215808 00000100:00100000:0.0:1788890873.398055:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996215808 00000100:00100000:0.0:1788890873.398090:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788890873.398098:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996215808:12345-0@lo:502: 00000100:00100000:0.0:1788890873.398299:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996215808:12345-0@lo:502: Request processed in 201us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.398306:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788890873.398451:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215808:0@lo:502: 00000040:00080000:1.0:1788890873.398715:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788890873.398757:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788890873.398786:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788890873.398831:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788890873.398868:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788890873.399016:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788890873.399057:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788890873.399093:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788890873.399140:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788890873.399248:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788890873.399289:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788890873.399340:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788890873.399376:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788890873.399411:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788890873.399461:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788890873.399498:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788890873.399532:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788890873.399610:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788890873.399660:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788890873.399692:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788890873.399748:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788890873.399786:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788890873.399820:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788890873.399871:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788890873.400084:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788890873.400127:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788890873.400404:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788890873.400447:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788890873.400483:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788890873.400539:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788890873.400593:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788890873.400645:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788890873.400677:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788890873.400718:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788890873.400764:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788890873.400809:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788890873.400845:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788890873.400893:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215936:0@lo:502: 00000100:00100000:1.0:1788890873.401425:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.401531:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890873.401600:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996215936 00000100:00100000:0.0:1788890873.401609:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996215936 00000100:00100000:0.0:1788890873.401724:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788890873.401740:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996215936:12345-0@lo:502: 00000100:00100000:0.0:1788890873.402127:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996215936:12345-0@lo:502: Request processed in 393us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.402135:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788890873.402330:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996215936:0@lo:502: 00000040:00080000:1.0:1788890873.402428:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788890873.402443:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788890873.403061:0:7618:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788890873.403077:0:7618:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9da1cae5cd28) 00000020:00000080:3.0:1788890873.403101:0:7618:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788890873.403377:0:7618:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da1c5240800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788890873.403382:0:7618:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9da1c5240800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788890873.403385:0:7618:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1c5240800 3 00010000:00080000:3.0:1788890873.403431:0:7618:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da1f9bc2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.118@tcp at head 00010000:00010000:3.0:1788890873.405507:0:7618:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788890873.405798:0:7618:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788890873.405839:0:7618:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788890873.405857:0:7618:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9161b78f8ec3ed4b 00000100:00080000:3.0:1788890873.405870:0:7618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788890873.405885:0:7618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9da1f9bc2800 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788890873.405933:0:7618:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f0260a80 x1875787996216064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788890873.405967:0:7618:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788890873.406201:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788890873.406218:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996216192:0@lo:400: 00000100:00100000:2.0:1788890873.406290:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890873.406335:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996216320:0@lo:400: 00000100:00100000:2.0:1788890873.406358:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890873.406379:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788890873.406385:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996216448:0@lo:400: 00000100:00100000:2.0:1788890873.406410:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890873.406453:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996216192 00000100:00100000:2.0:1788890873.406459:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996216192 00000100:00100000:2.0:1788890873.406498:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996216320 00000100:00100000:2.0:1788890873.406501:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996216320 00000100:00100000:2.0:1788890873.406535:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788890873.406558:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996216192:12345-0@lo:400: 00000100:00100000:2.0:1788890873.406610:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996216192:12345-0@lo:400: Request processed in 66us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.406618:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788890873.406632:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788890873.406639:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996216320:12345-0@lo:400: 00000100:00100000:2.0:1788890873.406680:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996216320:12345-0@lo:400: Request processed in 42us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.406687:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788890873.406712:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996216448 00000100:00100000:2.0:1788890873.406716:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996216448 00000100:00100000:2.0:1788890873.406743:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890873.406749:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996216448:12345-0@lo:400: 00000100:00100000:2.0:1788890873.406776:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996216448:12345-0@lo:400: Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.406781:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788890873.406800:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788890873.406805:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788890873.406833:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f4d47800 x1875787996216448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890873.406846:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996216448:0@lo:400: 00010000:00080000:2.0:1788890873.406859:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f4d44700 x1875787996216320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890873.406868:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996216320:0@lo:400: 00010000:00080000:2.0:1788890873.406901:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f4d45f80 x1875787996216192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890873.406984:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996216192:0@lo:400: 00000040:00080000:2.0:1788890873.407246:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1788890873.407382:0:7619:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9da1f4d45f80 x1875787996216576/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890873.407391:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8ba4480 going to sleep for 0 seconds 00000100:00100000:1.0:1788890873.407479:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0260a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1875787996216064:0@lo:38: 00000100:00100000:1.0:1788890873.407520:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788890873.407584:0:7607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788890873.407609:0:7607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788890873.407622:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890873.407634:0:7607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788890873.407680:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788890873.407682:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788890873.407684:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890873.407685:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890873.407686:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890873.407688:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890873.407691:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788890873.407692:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890873.407694:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890873.407701:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890873.407702:0:7607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788890873.407705:0:7607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788890873.407708:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788890873.407709:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788890873.407710:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890873.407711:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890873.407712:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890873.407713:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890873.407714:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788890873.407715:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890873.407716:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890873.407717:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890873.407718:0:7607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788890873.407730:0:7607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788890873.407738:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996216704:0@lo:253: 00000100:00100000:1.0:1788890873.407769:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890873.407782:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788890873.407843:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996216064 00000100:00100000:2.0:1788890873.407848:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996216064 00000100:00100000:2.0:1788890873.407874:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890873.407880:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3278:x1875787996216064:12345-0@lo:38: 00010000:00080000:2.0:1788890873.407899:0:6852:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 97 last 0 00000020:00000080:2.0:1788890873.408000:0:6852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9161b78f8ec3ed52 00000004:00100000:2.0:1788890873.408013:0:6852:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788890873.408042:0:6852:0:(import.c:65:import_set_state_nolock()) ffff9da1f5305800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890873.408136:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875787996216064:12345-0@lo:38: Request processed in 254us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.408143:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890873.408193:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996216704 00000100:00100000:2.0:1788890873.408198:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996216704 00000100:00100000:2.0:1788890873.408224:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788890873.408230:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:7607:x1875787996216704:12345-0@lo:253: 20000000:01000000:2.0:1788890873.408250:0:5808:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788890873.408264:0:5808:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788890873.411941:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f0260a80 x1875787996216064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788890883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890873.411958:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788890873.411967:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788890873.411976:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788890873.411981:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788890873.411985:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788890873.411993:0:3278:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b70dd3d6): req@ffff9da1f4d45f80 x1875787996216576/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890873.412018:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0260a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1875787996216064:0@lo:38: 00000100:00100000:0.0:1788890873.412253:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890873.412295:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8ba4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788890873.414032:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996216576 00000100:00100000:1.0:1788890873.414044:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996216576 00000100:00100000:1.0:1788890873.414117:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788890873.414128:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7619:x1875787996216576:12345-0@lo:901: 00000100:00100000:1.0:1788890873.414627:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7619:x1875787996216576:12345-0@lo:901: Request processed in 501us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890873.414635:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788890873.414696:0:7619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1f4d45f80 x1875787996216576/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788890889 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890873.414711:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7619:1875787996216576:0@lo:901: 00000100:00080000:0.0:1788890873.414904:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1788890873.433113:0:5808:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788890873.433134:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788890873.433377:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788890873.433382:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788890873.433401:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.433419:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec95 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.433428:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.433463:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ec95 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890873.433477:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec95 expref: 14 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890873.433491:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875787996216832:0@lo:104: 00000100:00100000:3.0:1788890873.433564:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890873.433619:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0edd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788890873.433663:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996216832 00000100:00100000:2.0:1788890873.433670:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996216832 00000100:00100000:2.0:1788890873.433715:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788890873.433725:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5830:x1875787996216832:12345-0@lo:104: 00010000:00010000:2.0:1788890873.433737:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.433786:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890873.433792:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+3:5830:x1875787996216832:12345-0@lo:104: Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.433813:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788890873.433836:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890873.433841:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.433849:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da202179600 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788890873.433853:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.433861:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890873.433868:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890873.433874:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788890873.433899:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.433906:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890873.433923:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.433929:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da202179600/0x9161b78f8ec3ec95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.433944:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890873.433945:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890873.433947:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890873.433957:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996216960:0@lo:103: 00000100:00100000:2.0:1788890873.433988:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890873.434023:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996216960 00000100:00100000:2.0:1788890873.434026:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996216960 00010000:00010000:2.0:1788890873.434042:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec95 expref: 15 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890873.434064:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788890873.434071:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:3279:x1875787996216960:12345-0@lo:103: 00010000:00010000:2.0:1788890873.434081:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890873.434085:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec95 expref: 15 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434095:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec95 expref: 15 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434110:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434117:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788890873.434129:0:5800:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000813853s 00010000:00010000:2.0:1788890873.434133:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434140:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434148:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434164:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434193:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da202179400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890873.434197:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434205:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434214:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434223:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890873.434251:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:3279:x1875787996216960:12345-0@lo:103: Request processed in 181us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890873.434258:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788890873.434295:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996216960:0@lo:103: 00010000:00010000:2.0:1788890873.434321:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec3ec9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ec95 expref: 14 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890873.434330:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875787996216832:0@lo:104: 00010000:00010000:2.0:1788890873.434341:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434350:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434356:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890873.434368:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da202179400/0x9161b78f8ec3ed59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890873.438727:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:7607:x1875787996216704:12345-0@lo:253: Request processed in 30488us (30948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890873.438742:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788890873.438859:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68b804f9-71ae-42dc-a11e-677332e27dfa:7607:1875787996216704:0@lo:253: 10000000:01000000:1.0:1788890873.438873:0:7607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788890873.438877:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788890873.438878:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788890873.438879:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788890873.438880:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788890873.438881:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788890873.438883:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788890873.438884:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788890873.438886:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788890873.438887:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788890873.438889:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788890873.438890:0:7607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788890873.438913:0:7607:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788890873.443025:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788890873.443374:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788890873.443599:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788890873.443774:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788890873.444309:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788890873.444518:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788890873.445628:0:7607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788890873.647289:0:7607:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788890873.647296:0:7607:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788890873.647326:0:7607:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788890873.647395:0:7607:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788890873.647410:0:7607:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788890873.647435:0:7607:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788890873.975304:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890874.999350:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890875.965668:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890875.965692:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996217088:0@lo:13: 00000100:00100000:1.0:1788890875.965757:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890875.965825:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996217088 00000100:00100000:1.0:1788890875.965832:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996217088 00000100:00100000:1.0:1788890875.965882:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788890875.965891:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996217088:12345-0@lo:13: 00002000:00000024:1.0:1788890875.965923:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890875.965962:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996217088:12345-0@lo:13: Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890875.965969:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788890875.965987:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788890875.966015:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1cae22a00 x1875787996217088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890875.966032:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996217088:0@lo:13: 00010000:00010000:2.0:1788890876.026033:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890877.053551:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890878.070333:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890878.519970:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996217216:0@lo:400: 00000100:00100000:2.0:1788890878.520039:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.520146:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996217216 00000100:00100000:0.0:1788890878.520154:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996217216 00000100:00100000:0.0:1788890878.520210:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788890878.520219:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:3281:x1875787996217216:12345-0@lo:400: 00000100:00100000:3.0:1788890878.520393:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996217344:0@lo:400: 00000100:00100000:0.0:1788890878.520521:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:3281:x1875787996217216:12345-0@lo:400: Request processed in 303us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890878.520529:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788890878.520561:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996217600:0@lo:400: 00000100:00100000:0.0:1788890878.520584:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.520629:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890878.520635:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996217472:0@lo:400: 00000100:00100000:0.0:1788890878.520657:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890878.520693:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996217600 00000100:00100000:0.0:1788890878.520697:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996217600 00000100:00100000:0.0:1788890878.520733:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890878.520739:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996217600:12345-0@lo:400: 00000100:00100000:0.0:1788890878.520775:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996217600:12345-0@lo:400: Request processed in 36us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890878.520781:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890878.520799:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996217472 00000100:00100000:0.0:1788890878.520802:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996217472 00000100:00100000:0.0:1788890878.520829:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890878.520836:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996217472:12345-0@lo:400: 00000100:00100000:0.0:1788890878.520865:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996217472:12345-0@lo:400: Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890878.520871:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788890878.520894:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788890878.520900:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788890878.520937:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0261880 x1875787996217472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890878.520951:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996217472:0@lo:400: 00010000:00080000:0.0:1788890878.520962:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0262300 x1875787996217600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890878.520970:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996217600:0@lo:400: 00000100:00100000:2.0:1788890878.524219:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996217216:0@lo:400: 00000100:00100000:2.0:1788890878.524274:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996217728:0@lo:400: 00000100:00100000:2.0:1788890878.524330:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890878.524367:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996217728 00000100:00100000:2.0:1788890878.524373:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996217728 00000100:00100000:2.0:1788890878.524424:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788890878.524432:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996217728:12345-0@lo:400: 00000100:00100000:2.0:1788890878.524492:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996217728:12345-0@lo:400: Request processed in 60us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890878.524500:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788890878.524520:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788890878.524544:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0261500 x1875787996217728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890878.524557:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996217728:0@lo:400: 00000100:00100000:3.0:1788890878.526012:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890878.528886:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996217344 00000100:00100000:2.0:1788890878.528902:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996217344 00000100:00100000:2.0:1788890878.531537:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788890878.531552:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996217344:12345-0@lo:400: 00000100:00100000:2.0:1788890878.531660:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996217344:12345-0@lo:400: Request processed in 111us (5652us total) trans 0 rc 0/0 00010000:00080000:1.0:1788890878.531774:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0263480 x1875787996217344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890878.531790:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996217344:0@lo:400: 00000100:00100000:2.0:1788890878.531841:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:02000400:3.0:1788890878.909469:0:7962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788890879.095114:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890880.118464:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890881.078561:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996217856:0@lo:13: 00000100:00100000:0.0:1788890881.078653:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890881.078786:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996217856 00000100:00100000:1.0:1788890881.078794:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996217856 00000100:00100000:1.0:1788890881.078852:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788890881.078861:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996217856:12345-0@lo:13: 00002000:00000024:1.0:1788890881.078895:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890881.078935:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996217856:12345-0@lo:13: Request processed in 76us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890881.078942:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788890881.079111:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1cae22a00 x1875787996217856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890881.079130:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996217856:0@lo:13: 00000100:00080000:2.0:1788890881.079551:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788890881.144277:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890882.167671:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788890882.614403:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788890882.614411:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1f4e26000 from 30 10000000:01000000:2.0:1788890882.614416:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788890882.614457:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890882.614469:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890882.614480:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890882.614502:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996217984:0@lo:101: 00000100:00100000:2.0:1788890882.614568:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.614735:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2b99f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.614880:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996217984 00000100:00100000:0.0:1788890882.614886:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996217984 00000100:00100000:0.0:1788890882.614929:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788890882.614937:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996217984:12345-0@lo:101: 00010000:00010000:0.0:1788890882.614951:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890882.614962:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ed60 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.614983:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed60 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.614992:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed60 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.615019:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031000, rc 0) 00000100:00100000:0.0:1788890882.615063:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996217984:12345-0@lo:101: Request processed in 127us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.615069:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788890882.615349:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996217984:0@lo:101: 00010000:00010000:2.0:1788890882.615375:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890882.615384:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890882.615436:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218112:0@lo:501: 00000100:00100000:2.0:1788890882.615461:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.615554:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996218112 00000100:00100000:0.0:1788890882.615571:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996218112 00000100:00100000:0.0:1788890882.615603:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788890882.615609:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996218112:12345-0@lo:501: 00000100:00100000:0.0:1788890882.615955:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996218112:12345-0@lo:501: Request processed in 346us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.615963:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788890882.616918:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2b99f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890882.616939:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218112:0@lo:501: 00000100:00100000:2.0:1788890882.616988:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218240:0@lo:503: 00000100:00100000:2.0:1788890882.617033:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.617100:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2b99f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.617141:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996218240 00000100:00100000:0.0:1788890882.617146:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996218240 00000100:00100000:0.0:1788890882.617238:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788890882.617246:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996218240:12345-0@lo:503: 00000100:00100000:0.0:1788890882.617539:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996218240:12345-0@lo:503: Request processed in 294us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.617545:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788890882.617615:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218240:0@lo:503: 00000100:00100000:2.0:1788890882.618445:0:8129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8129:1875787996218368:0@lo:502: 00000100:00100000:2.0:1788890882.618491:0:8129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.618922:0:8129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2b99840 going to sleep for 11 seconds 00000100:00100000:1.0:1788890882.618960:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996218368 00000100:00100000:1.0:1788890882.618965:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996218368 00000100:00100000:3.0:1788890882.619025:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788890882.619035:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:8129:x1875787996218368:12345-0@lo:502: 00000100:00100000:3.0:1788890882.619410:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:8129:x1875787996218368:12345-0@lo:502: Request processed in 376us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890882.619418:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788890882.619616:0:8129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8129:1875787996218368:0@lo:502: 00000100:00100000:2.0:1788890882.619664:0:8129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8129:1875787996218496:0@lo:502: 00000100:00100000:2.0:1788890882.619698:0:8129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.619714:0:8129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c32d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788890882.619863:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996218496 00000100:00100000:3.0:1788890882.619867:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996218496 00000100:00100000:3.0:1788890882.619896:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788890882.619902:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:8129:x1875787996218496:12345-0@lo:502: 00000100:00100000:3.0:1788890882.620050:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:8129:x1875787996218496:12345-0@lo:502: Request processed in 148us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890882.620057:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788890882.620290:0:8129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8129:1875787996218496:0@lo:502: 00000040:00080000:2.0:1788890882.620311:0:8129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788890882.620481:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788890882.620514:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788890882.620524:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890882.620535:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890882.620544:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788890882.620553:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788890882.620556:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788890882.620579:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890882.620587:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890882.620598:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890882.620611:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218624:0@lo:101: 00000100:00100000:3.0:1788890882.620639:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890882.620708:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f5377c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890882.620926:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996218624 00000100:00100000:1.0:1788890882.620932:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996218624 00000100:00100000:1.0:1788890882.620954:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788890882.620961:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996218624:12345-0@lo:101: 00010000:00010000:1.0:1788890882.620969:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890882.620980:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ed6e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.620999:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed6e expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.621008:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed6e expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.621016:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c13f8e00, rc 0) 00000100:00100000:1.0:1788890882.621055:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996218624:12345-0@lo:101: Request processed in 94us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890882.621061:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788890882.621135:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218624:0@lo:101: 00010000:00010000:3.0:1788890882.621147:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890882.621157:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890882.621228:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218752:0@lo:501: 00000100:00100000:3.0:1788890882.621252:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890882.621271:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f5377c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890882.621917:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996218752 00000100:00100000:1.0:1788890882.621922:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996218752 00000100:00100000:1.0:1788890882.621941:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788890882.621948:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996218752:12345-0@lo:501: 00000100:00100000:1.0:1788890882.622159:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996218752:12345-0@lo:501: Request processed in 209us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890882.622184:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788890882.622397:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218752:0@lo:501: 00000100:00100000:3.0:1788890882.622426:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218880:0@lo:503: 00000100:00100000:3.0:1788890882.622464:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890882.622497:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f5377c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890882.622546:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996218880 00000100:00100000:2.0:1788890882.622551:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996218880 00000100:00100000:2.0:1788890882.622583:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788890882.622591:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996218880:12345-0@lo:503: 00000100:00100000:2.0:1788890882.622995:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996218880:12345-0@lo:503: Request processed in 404us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890882.623002:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788890882.623121:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996218880:0@lo:503: 00000100:00100000:3.0:1788890882.623722:0:8130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8130:1875787996219008:0@lo:502: 00000100:00100000:3.0:1788890882.623899:0:8130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890882.623925:0:8130:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f5377cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890882.624003:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996219008 00000100:00100000:2.0:1788890882.624008:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996219008 00000100:00100000:2.0:1788890882.624043:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788890882.624051:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:8130:x1875787996219008:12345-0@lo:502: 00000100:00100000:2.0:1788890882.624318:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:8130:x1875787996219008:12345-0@lo:502: Request processed in 268us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890882.624331:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788890882.624456:0:8130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8130:1875787996219008:0@lo:502: 00000020:01000000:1.0:1788890882.624481:0:8130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890882.624491:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890882.624493:0:8130:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788890882.624505:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788890882.624507:0:8130:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788890882.624525:0:8130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8130:1875787996219136:0@lo:502: 00000100:00100000:1.0:1788890882.624558:0:8130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.624586:0:8130:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9c90480 going to sleep for 11 seconds 00000100:00100000:2.0:1788890882.624630:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996219136 00000100:00100000:2.0:1788890882.624634:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996219136 00000100:00100000:2.0:1788890882.631605:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788890882.631632:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:8130:x1875787996219136:12345-0@lo:502: 00000100:00100000:2.0:1788890882.631910:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:8130:x1875787996219136:12345-0@lo:502: Request processed in 292us (7351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890882.631918:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788890882.632040:0:8130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8130:1875787996219136:0@lo:502: 00000020:01000000:1.0:1788890882.632077:0:8130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890882.632084:0:8130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890882.632086:0:8130:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788890882.632093:0:8130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788890882.632163:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788890882.632208:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788890882.632218:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.632228:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890882.632237:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788890882.632240:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1c9db0800 from 30 10000000:01000000:1.0:1788890882.632242:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890882.632271:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.632279:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.632288:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890882.632307:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996219264:0@lo:101: 00000100:00100000:1.0:1788890882.632346:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.640267:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9c90480 going to sleep for 11 seconds 00000100:00100000:3.0:1788890882.640570:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996219264 00000100:00100000:3.0:1788890882.640579:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996219264 00000100:00100000:3.0:1788890882.640631:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788890882.640647:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996219264:12345-0@lo:101: 00010000:00010000:3.0:1788890882.640663:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890882.640681:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ed7c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890882.640709:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed7c expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890882.640721:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed7c expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890882.640869:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da202179600, rc 0) 00000100:00100000:3.0:1788890882.640981:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996219264:12345-0@lo:101: Request processed in 341us (8633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890882.640987:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788890882.644579:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996219264:0@lo:101: 00010000:00010000:1.0:1788890882.644608:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.644620:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890882.644689:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996219392:0@lo:501: 00000100:00100000:1.0:1788890882.644755:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.644914:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9c90480 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.644992:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996219392 00000100:00100000:0.0:1788890882.644999:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996219392 00000100:00100000:0.0:1788890882.645050:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788890882.645058:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996219392:12345-0@lo:501: 00000100:00100000:0.0:1788890882.645341:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996219392:12345-0@lo:501: Request processed in 283us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.645349:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788890882.645623:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996219392:0@lo:501: 00000100:00100000:1.0:1788890882.645658:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996219520:0@lo:503: 00000100:00100000:1.0:1788890882.645695:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.645712:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9c90480 going to sleep for 11 seconds 00000100:00100000:1.0:1788890882.645739:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996219520 00000100:00100000:1.0:1788890882.645743:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996219520 00000100:00100000:1.0:1788890882.645765:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788890882.645772:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996219520:12345-0@lo:503: 00000100:00100000:1.0:1788890882.646206:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996219520:12345-0@lo:503: Request processed in 432us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890882.646213:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788890882.646251:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996219520:0@lo:503: 00000100:00100000:1.0:1788890882.646419:0:8132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8132:1875787996219648:0@lo:502: 00000100:00100000:1.0:1788890882.646459:0:8132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.646477:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996219648 00000100:00100000:1.0:1788890882.646481:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996219648 00000100:00100000:1.0:1788890882.646498:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788890882.646503:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+16:8132:x1875787996219648:12345-0@lo:502: 00000100:00100000:1.0:1788890882.646639:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+16:8132:x1875787996219648:12345-0@lo:502: Request processed in 134us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890882.646645:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788890882.646672:0:8132:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9c90600 going to sleep for 11 seconds 00000100:00100000:1.0:1788890882.646684:0:8132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8132:1875787996219648:0@lo:502: 00000100:00100000:1.0:1788890882.646894:0:8132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8132:1875787996219776:0@lo:502: 00000100:00100000:1.0:1788890882.646929:0:8132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.646961:0:8132:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9c90600 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.647017:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996219776 00000100:00100000:0.0:1788890882.647027:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996219776 00000100:00100000:0.0:1788890882.647050:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788890882.647057:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:8132:x1875787996219776:12345-0@lo:502: 00000100:00100000:0.0:1788890882.647257:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:8132:x1875787996219776:12345-0@lo:502: Request processed in 200us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.647264:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788890882.647382:0:8132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8132:1875787996219776:0@lo:502: 00000040:00080000:1.0:1788890882.647402:0:8132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788890882.647988:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788890882.648007:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788890882.648017:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.648029:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890882.648039:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788890882.648042:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9da1c9db0800 from 5 10000000:01000000:0.0:1788890882.648045:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788890882.648076:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.648084:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.648095:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.648111:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996219904:0@lo:101: 00000100:00100000:0.0:1788890882.648145:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.648210:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c51ae240 going to sleep for 11 seconds 00000100:00100000:1.0:1788890882.648306:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996219904 00000100:00100000:1.0:1788890882.648312:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996219904 00000100:00100000:1.0:1788890882.648346:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788890882.648354:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996219904:12345-0@lo:101: 00010000:00010000:1.0:1788890882.648373:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890882.648387:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ed91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ed8a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.648407:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ed91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed8a expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.648418:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ed91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed8a expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.648437:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c13f9800, rc 0) 00000100:00100000:1.0:1788890882.648541:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996219904:12345-0@lo:101: Request processed in 187us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890882.648547:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788890882.648615:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996219904:0@lo:101: 00010000:00010000:0.0:1788890882.648640:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.648650:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.648704:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996220032:0@lo:256: 00000100:00100000:0.0:1788890882.648884:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.648965:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c51ae240 going to sleep for 11 seconds 00000100:00100000:3.0:1788890882.656267:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996220032 00000100:00100000:3.0:1788890882.656283:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996220032 00000100:00100000:3.0:1788890882.656746:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788890882.656758:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996220032:12345-0@lo:256: 20000000:01000000:3.0:1788890882.656872:0:5807:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788890882.656890:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788890882.656900:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788890882.657042:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996220032:12345-0@lo:256: Request processed in 286us (8157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890882.657051:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788890882.657134:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996220032:0@lo:256: 10000000:01000000:1.0:1788890882.657239:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788890882.657249:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.657259:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890882.657268:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788890882.657271:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788890882.657274:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788890882.657315:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.657323:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890882.657332:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890882.657351:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996220160:0@lo:101: 00000100:00100000:1.0:1788890882.657399:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.660783:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9c906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890882.660947:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996220160 00000100:00100000:2.0:1788890882.660955:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996220160 00000100:00100000:2.0:1788890882.660997:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788890882.661006:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996220160:12345-0@lo:101: 00010000:00010000:2.0:1788890882.661020:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890882.661037:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ed98 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890882.661064:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed98 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890882.661075:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed98 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890882.661084:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29ef200, rc 0) 00000100:00100000:2.0:1788890882.661142:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996220160:12345-0@lo:101: Request processed in 137us (3743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890882.661149:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788890882.661211:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996220160:0@lo:101: 00010000:00010000:2.0:1788890882.661235:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890882.661244:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890882.661308:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996220288:0@lo:501: 00000100:00100000:2.0:1788890882.661337:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.661356:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c32d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788890882.664464:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996220288 00000100:00100000:2.0:1788890882.664475:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996220288 00000100:00100000:2.0:1788890882.664522:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788890882.664531:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996220288:12345-0@lo:501: 00000100:00100000:2.0:1788890882.664861:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996220288:12345-0@lo:501: Request processed in 330us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890882.664868:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788890882.664913:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996220288:0@lo:501: 00000100:00100000:2.0:1788890882.664958:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996220416:0@lo:503: 00000100:00100000:2.0:1788890882.665000:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.665026:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c32d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788890882.665037:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996220416 00000100:00100000:2.0:1788890882.665040:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996220416 00000100:00100000:2.0:1788890882.665055:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788890882.665059:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996220416:12345-0@lo:503: 00000100:00100000:2.0:1788890882.665356:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996220416:12345-0@lo:503: Request processed in 295us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890882.665806:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788890882.665857:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996220416:0@lo:503: 00000100:00100000:2.0:1788890882.668637:0:8133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8133:1875787996220544:0@lo:502: 00000100:00100000:2.0:1788890882.668720:0:8133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.668879:0:8133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c32d3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788890882.674470:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996220544 00000100:00100000:1.0:1788890882.674482:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996220544 00000100:00100000:1.0:1788890882.674539:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788890882.674550:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8133:x1875787996220544:12345-0@lo:502: 00000100:00100000:1.0:1788890882.679395:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8133:x1875787996220544:12345-0@lo:502: Request processed in 4839us (10667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890882.679409:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788890882.679627:0:8133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8133:1875787996220544:0@lo:502: 00000020:01000000:3.0:1788890882.679669:0:8133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788890882.679676:0:8133:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788890882.679683:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890882.679685:0:8133:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788890882.679690:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788890882.679694:0:8133:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.118@tcp to nid 0x20000c0a8cc76 (192.168.204.118@tcp) 00000020:01000000:3.0:1788890882.679715:0:8133:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788890882.679717:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788890882.679745:0:8133:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9da1cae5b370) 00000020:00000080:3.0:1788890882.679765:0:8133:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788890882.679771:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788890882.679845:0:8133:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788890882.679851:0:8133:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788890882.679856:0:8133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3edad 00010000:00080000:3.0:1788890882.679888:0:8133:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da1f9bc5800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.118@tcp at head 00010000:00010000:3.0:1788890882.680124:0:8133:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788890882.680468:0:8133:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788890882.680481:0:8133:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788890882.680997:0:8133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788890882.681213:0:8133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788890882.681259:0:8133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788890882.681317:0:8133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788890882.686902:0:8134:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788890882.686909:0:8134:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788890882.697563:0:8133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788890882.697579:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788890882.697618:0:8133:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788890882.697659:0:8133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec3edb4 00000100:00080000:1.0:1788890882.697670:0:8133:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788890882.697675:0:8133:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9da1f9bc5800 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:1.0:1788890882.697711:0:8133:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1cae21180 x1875787996220672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788890882.697870:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996220672:0@lo:8: 00000100:00100000:0.0:1788890882.697936:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788890882.700386:0:8133:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788890882.700471:0:8133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890882.700477:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890882.700480:0:8133:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788890882.700483:0:8133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890882.700487:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890882.700488:0:8133:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788890882.700491:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788890882.700493:0:8133:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788890882.700528:0:8133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8133:1875787996220800:0@lo:502: 00000100:00100000:1.0:1788890882.700593:0:8133:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.700612:0:8133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9c906c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890882.701002:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996220928:0@lo:400: 00000100:00100000:1.0:1788890882.701035:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.701067:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890882.701073:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996221056:0@lo:400: 00000100:00100000:1.0:1788890882.701097:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.701513:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996221312:0@lo:400: 00000100:00100000:1.0:1788890882.701541:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890882.701562:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890882.701567:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996221184:0@lo:400: 00000100:00100000:1.0:1788890882.701591:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890882.701743:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996220928 00000100:00100000:3.0:1788890882.701757:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996220928 00000100:00100000:3.0:1788890882.701798:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996221056 00000100:00100000:3.0:1788890882.701801:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996221056 00000100:00100000:3.0:1788890882.701821:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996221312 00000100:00100000:3.0:1788890882.701824:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996221312 00000100:00100000:3.0:1788890882.701842:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890882.701849:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996220928:12345-0@lo:400: 00000100:00100000:3.0:1788890882.701900:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996220928:12345-0@lo:400: Request processed in 51us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890882.701907:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890882.701922:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788890882.701928:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996221056:12345-0@lo:400: 00000100:00100000:3.0:1788890882.701956:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996221056:12345-0@lo:400: Request processed in 28us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890882.701961:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788890882.701972:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890882.701978:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996221312:12345-0@lo:400: 00000100:00100000:3.0:1788890882.702001:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996221312:12345-0@lo:400: Request processed in 24us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890882.702006:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890882.702023:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996220800 00000100:00100000:3.0:1788890882.702026:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996220800 00000100:00100000:3.0:1788890882.702047:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788890882.702053:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8133:x1875787996220800:12345-0@lo:502: 00000100:00100000:3.0:1788890882.702300:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8133:x1875787996220800:12345-0@lo:502: Request processed in 246us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890882.702307:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1788890882.707931:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0262a00 x1875787996221056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890882.707949:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996221056:0@lo:400: 00010000:00080000:0.0:1788890882.707968:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0263100 x1875787996220928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890882.707977:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996220928:0@lo:400: 00000100:00100000:0.0:1788890882.708025:0:8133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8133:1875787996220800:0@lo:502: 00000020:01000000:0.0:1788890882.708061:0:8133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890882.708069:0:8133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890882.708071:0:8133:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788890882.708075:0:8133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788890882.708217:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788890882.708239:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788890882.708248:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.708271:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890882.708282:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788890882.708285:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9da1f024b370 from 1 10000000:01000000:0.0:1788890882.708288:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788890882.708319:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.708327:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.708336:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.708355:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996221440:0@lo:101: 00000100:00100000:0.0:1788890882.708427:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.708459:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c51aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.708481:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996221440 00000100:00100000:0.0:1788890882.708487:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996221440 00000100:00100000:0.0:1788890882.708527:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788890882.708536:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996221440:12345-0@lo:101: 00010000:00010000:0.0:1788890882.708548:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890882.708560:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3edbb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.708584:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3edbb expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.708604:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3edbb expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.708613:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031200, rc 0) 00000100:00100000:0.0:1788890882.708648:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996221440:12345-0@lo:101: Request processed in 113us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.708654:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788890882.708689:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996221440:0@lo:101: 00010000:00010000:0.0:1788890882.708702:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.708710:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890882.708763:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996221568:0@lo:501: 00000100:00100000:0.0:1788890882.708785:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.708797:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c51aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.708808:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996221568 00000100:00100000:0.0:1788890882.708811:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996221568 00000100:00100000:0.0:1788890882.708830:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788890882.708836:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996221568:12345-0@lo:501: 00000100:00100000:0.0:1788890882.709042:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996221568:12345-0@lo:501: Request processed in 205us (255us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788890882.709048:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788890882.709077:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996221568:0@lo:501: 10000000:01000000:0.0:1788890882.709095:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788890882.709106:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890882.709114:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788890882.709671:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0263480 x1875787996221312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788890898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890882.709684:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996221312:0@lo:400: 00000100:00080000:1.0:1788890882.710240:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890882.710903:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996220672 00000100:00100000:2.0:1788890882.710911:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996220672 00000100:00100000:2.0:1788890882.710948:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996221184 00000100:00100000:2.0:1788890882.710951:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996221184 00000100:00100000:2.0:1788890882.710974:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890882.710983:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996221184:12345-0@lo:400: 00000100:00100000:2.0:1788890882.711052:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996221184:12345-0@lo:400: Request processed in 70us (9460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890882.711058:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890882.711073:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788890882.711077:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3278:x1875787996220672:12345-0@lo:8: 00010000:00080000:2.0:1788890882.711101:0:6664:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:2.0:1788890882.711127:0:6664:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec3edc9 00002000:00100000:2.0:1788890882.711142:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9da1fb99e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788890882.711146:0:6664:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788890882.711150:0:6664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788890882.711284:0:6664:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788890882.711463:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788890882.711488:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9da1fb99a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890882.711531:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875787996220672:12345-0@lo:8: Request processed in 452us (13595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890882.711539:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788890882.711606:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1cae21180 x1875787996220672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788890892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890882.711615:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788890882.711623:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788890882.711630:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788890882.711635:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788890882.711637:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788890882.711651:0:3278:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788890882.711655:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996220672:0@lo:8: 00000004:00080000:2.0:1788890882.711683:0:8134:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788890882.712127:0:8134:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 106560958057ns, next at 0ns, rc = 0 00010000:00080000:2.0:1788890882.712165:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0261c00 x1875787996221184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890882.712202:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996221184:0@lo:400: 00000004:00080000:0.0:1788890882.750815:0:8135:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788890882.750844:0:8135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8135:1875787996221824:0@lo:7: 00000100:00100000:0.0:1788890882.750907:0:8135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.750953:0:8135:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c4372540 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.750968:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996221696:0@lo:13: 00000100:00100000:0.0:1788890882.750992:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.751029:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996221824 00000100:00100000:0.0:1788890882.751036:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996221824 00000100:00100000:0.0:1788890882.751083:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788890882.751092:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8135:x1875787996221824:12345-0@lo:7: 00000004:00080000:1.0:1788890882.753781:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788890882.753875:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996221696 00000100:00100000:1.0:1788890882.753883:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996221696 00000100:00100000:1.0:1788890882.753938:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788890882.753948:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875787996221696:12345-0@lo:13: 00002000:00000024:1.0:1788890882.753972:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788890882.754042:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875787996221696:12345-0@lo:13: Request processed in 96us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890882.754049:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788890882.754067:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788890882.754098:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da2018fc000 x1875787996221696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890882.754117:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996221696:0@lo:13: 00002000:00080000:0.0:1788890882.757052:0:6664:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788890882.757061:0:6664:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788890882.757397:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8135:x1875787996221824:12345-0@lo:7: Request processed in 6302us (6486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890882.757408:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788890882.757527:0:8135:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da2018ffb80 x1875787996221824/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788890898 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890882.757543:0:8135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8135:1875787996221824:0@lo:7: 00000004:00080000:2.0:1788890882.757555:0:8135:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788890882.757593:0:8135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d44a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8135:1875787996221952:0@lo:5: 00000100:00100000:2.0:1788890882.757629:0:8135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.757662:0:8135:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0f27840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.757706:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996221952 00000100:00100000:0.0:1788890882.757713:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996221952 00000100:00100000:0.0:1788890882.757765:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788890882.757774:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8135:x1875787996221952:12345-0@lo:5: 00002000:00080000:0.0:1788890882.757813:0:6663:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788890882.757817:0:6663:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788890882.758039:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8135:x1875787996221952:12345-0@lo:5: Request processed in 265us (409us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788890882.758056:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788890882.758617:0:8135:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f4d44a80 x1875787996221952/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890898 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890882.758628:0:8135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d44a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8135:1875787996221952:0@lo:5: 00000004:00080000:2.0:1788890882.758638:0:8135:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788890882.758671:0:8135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8135:1875787996222080:0@lo:700: 00000100:00100000:2.0:1788890882.758696:0:8135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890882.758726:0:8135:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0f27840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.758840:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996222080 00000100:00100000:0.0:1788890882.758845:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996222080 00000100:00100000:0.0:1788890882.758873:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890882.758880:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8135:x1875787996222080:12345-0@lo:700: 00000100:00100000:0.0:1788890882.758906:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6670:1875787996222208:0@lo:700: 00000100:00100000:0.0:1788890882.758936:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890882.759032:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c43729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890882.759195:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996222208 00000100:00100000:3.0:1788890882.759200:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996222208 00000100:00100000:3.0:1788890882.759230:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788890882.759238:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6670:x1875787996222208:12345-0@lo:700: 40000000:02000000:0.0:1788890882.812906:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788890882.820910:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6670:x1875787996222208:12345-0@lo:700: Request processed in 61662us (61962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890882.820953:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788890882.821044:0:6670:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da2018fd880 x1875787996222208/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788890898 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890882.821060:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6670:1875787996222208:0@lo:700: 40000000:02000000:0.0:1788890882.821072:0:6670:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788890882.881869:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788890882.881897:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788890882.882067:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8135:x1875787996222080:12345-0@lo:700: Request processed in 123183us (123365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890882.882083:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788890882.882148:0:8135:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f4d45180 x1875787996222080/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788890898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890882.882160:0:8135:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788890882.882254:0:8135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8135:1875787996222080:0@lo:700: 00000004:02000040:2.0:1788890882.909768:0:8135:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788890882.913604:0:8135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8135:1875787996222336:0@lo:5: 00000100:00100000:3.0:1788890882.913679:0:8135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890882.913732:0:8135:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788890882.913822:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996222336 00000100:00100000:0.0:1788890882.913829:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996222336 00000100:00100000:0.0:1788890882.914013:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788890882.914024:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8135:x1875787996222336:12345-0@lo:5: 00002000:00080000:0.0:1788890882.920452:0:6664:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788890882.920471:0:6664:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788890882.923689:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8135:x1875787996222336:12345-0@lo:5: Request processed in 9660us (10003us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788890882.923702:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788890882.923832:0:8135:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0261500 x1875787996222336/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788890898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890882.923852:0:8135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8135:1875787996222336:0@lo:5: 00000004:00080000:0.0:1788890882.923865:0:8135:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788890883.192290:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788890883.246138:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788890884.214324:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890884.652542:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890884.655468:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987812736 00000100:00100000:2.0:1788890884.655482:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987812736 00000100:00100000:2.0:1788890884.655594:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 106 00000100:00100000:2.0:1788890884.655603:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2371:x1875787987812736:12345-192.168.204.18@tcp:250: 00010000:00080000:2.0:1788890884.655630:0:5807:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 47df6031-18d1-4179-91e9-917028d5aced@192.168.204.18@tcp t0 exp 0000000000000000 cur 108 last 0 00000020:00000080:2.0:1788890884.655659:0:5807:0:(genops.c:1385:class_connect()) connect: client 47df6031-18d1-4179-91e9-917028d5aced, cookie 0x9161b78f8ec3edd0 00000100:00080000:2.0:1788890884.655815:0:5807:0:(import.c:65:import_set_state_nolock()) ffff9da1f4c1b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890884.655884:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+5:2371:x1875787987812736:12345-192.168.204.18@tcp:250: Request processed in 281us (3352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890884.655892:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 106 00000100:00100000:3.0:1788890884.659647:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890884.659944:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987812608 00000100:00100000:1.0:1788890884.659954:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987812608 00000100:00100000:1.0:1788890884.660044:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 107 00000100:00100000:1.0:1788890884.660053:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+5:5589:x1875787987812608:12345-192.168.204.18@tcp:101: 00010000:00010000:1.0:1788890884.660068:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890884.660085:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1b65 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.660113:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b65 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.660124:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b65 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.660132:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f000, rc 0) 00000100:00100000:1.0:1788890884.660215:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+6:5589:x1875787987812608:12345-192.168.204.18@tcp:101: Request processed in 163us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.660221:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 107 00000100:00100000:3.0:1788890884.665987:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890884.668414:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987812864 00000100:00100000:2.0:1788890884.668426:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987812864 00000100:00100000:2.0:1788890884.668497:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 108 00000100:00100000:2.0:1788890884.668507:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+6:5589:x1875787987812864:12345-192.168.204.18@tcp:501: 00000100:00100000:2.0:1788890884.668869:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+6:5589:x1875787987812864:12345-192.168.204.18@tcp:501: Request processed in 362us (2890us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788890884.668877:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 108 00000100:00100000:3.0:1788890884.673249:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890884.673371:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987812992 00000100:00100000:1.0:1788890884.673381:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987812992 00000100:00100000:1.0:1788890884.673487:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 109 00000100:00100000:1.0:1788890884.673497:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+6:5589:x1875787987812992:12345-192.168.204.18@tcp:101: 00010000:00010000:1.0:1788890884.673512:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890884.673541:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1b6c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.673568:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b6c expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.673578:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b6c expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.673587:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e200, rc 0) 00000100:00100000:1.0:1788890884.673642:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+7:5589:x1875787987812992:12345-192.168.204.18@tcp:101: Request processed in 147us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.673649:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 109 00000100:00100000:3.0:1788890884.678192:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890884.678332:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813120 00000100:00100000:0.0:1788890884.678342:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813120 00000100:00100000:0.0:1788890884.678449:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 110 00000100:00100000:0.0:1788890884.678459:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+7:5589:x1875787987813120:12345-192.168.204.18@tcp:501: 00000100:00100000:0.0:1788890884.678729:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+8:5589:x1875787987813120:12345-192.168.204.18@tcp:501: Request processed in 271us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890884.678750:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 110 00000100:00100000:3.0:1788890884.680922:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890884.682711:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813248 00000100:00100000:1.0:1788890884.682723:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813248 00000100:00100000:1.0:1788890884.682895:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 111 00000100:00100000:1.0:1788890884.682905:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+8:5589:x1875787987813248:12345-192.168.204.18@tcp:503: 00000100:00100000:1.0:1788890884.683234:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+8:5589:x1875787987813248:12345-192.168.204.18@tcp:503: Request processed in 329us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.683241:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 111 00000100:00100000:3.0:1788890884.691121:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890884.692388:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813376 00000100:00100000:0.0:1788890884.692398:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813376 00000100:00100000:0.0:1788890884.692456:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 112 00000100:00100000:0.0:1788890884.692464:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+8:5607:x1875787987813376:12345-192.168.204.18@tcp:502: 00000100:00100000:0.0:1788890884.692802:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+8:5607:x1875787987813376:12345-192.168.204.18@tcp:502: Request processed in 337us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890884.692810:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 112 00000100:00100000:3.0:1788890884.731501:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890884.731838:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813504 00000100:00100000:1.0:1788890884.731848:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813504 00000100:00100000:1.0:1788890884.731907:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 113 00000100:00100000:1.0:1788890884.731916:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+8:5607:x1875787987813504:12345-192.168.204.18@tcp:502: 00000100:00100000:1.0:1788890884.732217:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+8:5607:x1875787987813504:12345-192.168.204.18@tcp:502: Request processed in 301us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.732225:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 113 00000100:00100000:3.0:1788890884.739045:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890884.739136:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813632 00000100:00100000:2.0:1788890884.739145:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813632 00000100:00100000:2.0:1788890884.739224:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 114 00000100:00100000:2.0:1788890884.739235:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+8:5589:x1875787987813632:12345-192.168.204.18@tcp:101: 00010000:00010000:2.0:1788890884.739251:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890884.739268:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ede5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1b96 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890884.739296:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ede5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b96 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890884.739308:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ede5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b96 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890884.739328:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29ee800, rc 0) 00000100:00100000:2.0:1788890884.739380:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+9:5589:x1875787987813632:12345-192.168.204.18@tcp:101: Request processed in 148us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890884.739386:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 114 00000100:00100000:3.0:1788890884.741984:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890884.742065:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813760 00000100:00100000:0.0:1788890884.742072:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813760 00000100:00100000:0.0:1788890884.742117:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 115 00000100:00100000:0.0:1788890884.742124:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+9:5589:x1875787987813760:12345-192.168.204.18@tcp:256: 20000000:01000000:0.0:1788890884.742146:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788890884.742193:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788890884.742197:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788890884.742200:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788890884.742203:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788890884.743339:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+9:5589:x1875787987813760:12345-192.168.204.18@tcp:256: Request processed in 1210us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890884.743351:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 115 00000100:00100000:3.0:1788890884.750159:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890884.750284:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987813888 00000100:00100000:1.0:1788890884.750306:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987813888 00000100:00100000:1.0:1788890884.750514:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 116 00000100:00100000:1.0:1788890884.750524:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+9:5589:x1875787987813888:12345-192.168.204.18@tcp:101: 00010000:00010000:1.0:1788890884.750541:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890884.750557:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1b9d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.750585:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b9d expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.750597:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b9d expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890884.750606:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e400, rc 0) 00000100:00100000:1.0:1788890884.750661:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:5589:x1875787987813888:12345-192.168.204.18@tcp:101: Request processed in 138us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.750667:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 116 00000100:00100000:3.0:1788890884.753012:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890884.753896:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814016 00000100:00100000:0.0:1788890884.753921:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814016 00000100:00100000:0.0:1788890884.753977:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 117 00000100:00100000:0.0:1788890884.753986:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:5589:x1875787987814016:12345-192.168.204.18@tcp:501: 00000100:00100000:0.0:1788890884.754303:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:5589:x1875787987814016:12345-192.168.204.18@tcp:501: Request processed in 316us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890884.754311:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 117 00000100:00100000:3.0:1788890884.759532:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890884.759856:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814144 00000100:00100000:2.0:1788890884.759866:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814144 00000100:00100000:2.0:1788890884.759923:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 118 00000100:00100000:2.0:1788890884.759932:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:5589:x1875787987814144:12345-192.168.204.18@tcp:503: 00000100:00100000:2.0:1788890884.760489:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:5589:x1875787987814144:12345-192.168.204.18@tcp:503: Request processed in 555us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890884.760507:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 118 00000100:00100000:3.0:1788890884.764347:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890884.765293:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814272 00000100:00100000:1.0:1788890884.765304:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814272 00000100:00100000:1.0:1788890884.765424:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 119 00000100:00100000:1.0:1788890884.765434:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:5611:x1875787987814272:12345-192.168.204.18@tcp:502: 00000100:00100000:1.0:1788890884.765704:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:5611:x1875787987814272:12345-192.168.204.18@tcp:502: Request processed in 271us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890884.765712:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 119 00000100:00100000:3.0:1788890884.768530:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890884.768872:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814400 00000100:00100000:2.0:1788890884.768881:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814400 00000100:00100000:2.0:1788890884.768937:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 120 00000100:00100000:2.0:1788890884.768947:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:5611:x1875787987814400:12345-192.168.204.18@tcp:502: 00000100:00100000:2.0:1788890884.769729:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:5611:x1875787987814400:12345-192.168.204.18@tcp:502: Request processed in 780us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890884.770028:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 120 00000100:00100000:3.0:1788890884.774668:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890884.776083:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814528 00000100:00100000:2.0:1788890884.776097:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814528 00000100:00100000:2.0:1788890884.776155:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:2.0:1788890884.776163:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2371:x1875787987814528:12345-192.168.204.18@tcp:38: 00010000:00080000:2.0:1788890884.776214:0:6852:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp t0 exp 0000000000000000 cur 108 last 0 00000020:00000080:2.0:1788890884.776341:0:6852:0:(genops.c:1385:class_connect()) connect: client 671ae218-3c0c-4db9-9d11-9d6b732a0de5, cookie 0x9161b78f8ec3edf3 00000004:00100000:2.0:1788890884.776370:0:6852:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788890884.776376:0:6852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788890884.830487:0:6852:0:(import.c:65:import_set_state_nolock()) ffff9da1f4c19000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890884.830579:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2371:x1875787987814528:12345-192.168.204.18@tcp:38: Request processed in 54413us (55923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890884.830590:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 4 00010000:00010000:1.0:1788890885.238306:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890885.837419:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890885.837724:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814656 00000100:00100000:0.0:1788890885.837734:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814656 00000100:00100000:0.0:1788890885.837810:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:0.0:1788890885.837820:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:0:x1875787987814656:12345-192.168.204.18@tcp:41: 00000100:00100000:3.0:1788890885.837851:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000004:00000024:0.0:1788890885.837860:0:5814:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788890885.837902:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814784 00000100:00100000:3.0:1788890885.837906:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814784 00000100:00100000:0.0:1788890885.837920:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:0:x1875787987814656:12345-192.168.204.18@tcp:41: Request processed in 102us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890885.837927:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00080000:1.0:1788890885.837973:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890885.839023:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:3.0:1788890885.839038:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5589:x1875787987814784:12345-192.168.204.18@tcp:41: 00000004:00000024:3.0:1788890885.839057:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788890885.839104:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5589:x1875787987814784:12345-192.168.204.18@tcp:41: Request processed in 72us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890885.839112:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:3.0:1788890885.842046:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890885.842150:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987814912 00000100:00100000:0.0:1788890885.842159:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987814912 00000100:00100000:0.0:1788890885.842235:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:0.0:1788890885.842246:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5589:x1875787987814912:12345-192.168.204.18@tcp:40: 00000100:00100000:0.0:1788890885.842337:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5589:x1875787987814912:12345-192.168.204.18@tcp:40: Request processed in 93us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890885.842345:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:3.0:1788890885.848337:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890885.848382:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890885.848442:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890885.848545:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815040 00000100:00100000:0.0:1788890885.848554:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815040 00000100:00100000:0.0:1788890885.848590:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815168 00000100:00100000:0.0:1788890885.848593:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815168 00000100:00100000:0.0:1788890885.848605:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:0.0:1788890885.848613:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875787987815040:12345-192.168.204.18@tcp:8: 00010000:00080000:0.0:1788890885.848646:0:6662:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp t0 exp 0000000000000000 cur 109 last 0 00000020:00000080:0.0:1788890885.848675:0:6662:0:(genops.c:1385:class_connect()) connect: client 671ae218-3c0c-4db9-9d11-9d6b732a0de5, cookie 0x9161b78f8ec3edfa 00002000:00100000:0.0:1788890885.848689:0:6662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 671ae218-3c0c-4db9-9d11-9d6b732a0de5/ffff9da1cae1f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788890885.848715:0:6662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788890885.849038:0:6662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788890885.849066:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9da1cae1f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788890885.849138:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2371:x1875787987815040:12345-192.168.204.18@tcp:8: Request processed in 524us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890885.849145:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:0.0:1788890885.849162:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:0.0:1788890885.849196:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875787987815168:12345-192.168.204.18@tcp:8: 00010000:00080000:0.0:1788890885.849212:0:6662:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp t0 exp 0000000000000000 cur 109 last 0 00000020:00000080:0.0:1788890885.849227:0:6662:0:(genops.c:1385:class_connect()) connect: client 671ae218-3c0c-4db9-9d11-9d6b732a0de5, cookie 0x9161b78f8ec3ee01 00002000:00100000:0.0:1788890885.849232:0:6662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 671ae218-3c0c-4db9-9d11-9d6b732a0de5/ffff9da1cae1c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788890885.849246:0:6662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788890885.849438:0:6662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788890885.849456:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9da1cae1d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788890885.849480:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2371:x1875787987815168:12345-192.168.204.18@tcp:8: Request processed in 311us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890885.849487:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:1.0:1788890885.850008:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815296 00000100:00100000:1.0:1788890885.850015:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815296 00000100:00100000:1.0:1788890885.850064:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:1.0:1788890885.850071:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5589:x1875787987815296:12345-192.168.204.18@tcp:33: 00000100:00100000:1.0:1788890885.862854:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890885.862959:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815424 00000100:00100000:0.0:1788890885.862968:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815424 00000100:00100000:0.0:1788890885.863025:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 121 00000100:00100000:0.0:1788890885.863035:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987815424:12345-192.168.204.18@tcp:400: 00000100:00100000:0.0:1788890885.863114:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987815424:12345-192.168.204.18@tcp:400: Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890885.863122:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 121 00000004:00080000:1.0:1788890885.870766:0:5817:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20639us 00000004:00200000:2.0:1788890885.880708:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788890885.880814:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5589:x1875787987815296:12345-192.168.204.18@tcp:33: Request processed in 30738us (32426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890885.880828:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:1.0:1788890886.059342:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890886.059436:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815552 00000100:00100000:2.0:1788890886.059469:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815552 00000100:00100000:2.0:1788890886.059525:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:2.0:1788890886.059535:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5628:x1875787987815552:12345-192.168.204.18@tcp:101: 00010000:00010000:2.0:1788890886.059553:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890886.059601:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ee600/0x9161b78f8ec3ee08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1bc7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890886.059676:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3ee0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890886.059690:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890886.059706:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890886.059739:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788890886.059743:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890886.059759:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3ee0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890886.059783:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ee600/0x9161b78f8ec3ee08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bc7 expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890886.059812:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3ee0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bc7 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890886.059820:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890886.059823:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890886.059827:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29ef600, rc 0) 00000100:00100000:2.0:1788890886.060248:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:5628:x1875787987815552:12345-192.168.204.18@tcp:101: Request processed in 713us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890886.060256:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:0.0:1788890886.198737:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996222464:0@lo:13: 00000100:00100000:0.0:1788890886.198803:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890886.198921:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996222464 00000100:00100000:1.0:1788890886.198929:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996222464 00000100:00100000:1.0:1788890886.198997:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788890886.199007:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996222464:12345-0@lo:13: 00002000:00000024:1.0:1788890886.199028:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890886.199070:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996222464:12345-0@lo:13: Request processed in 66us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890886.199077:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788890886.199221:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1cae20380 x1875787996222464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890886.199240:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996222464:0@lo:13: 00000100:00080000:3.0:1788890886.199409:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788890886.262358:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890887.287647:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890887.735321:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788890887.735498:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996222720:0@lo:400: 00000100:00100000:2.0:1788890887.735566:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890887.736780:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996222592:0@lo:400: 00000100:00100000:2.0:1788890887.736817:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890887.736906:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996222592 00000100:00100000:3.0:1788890887.736915:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996222592 00000100:00100000:3.0:1788890887.736965:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788890887.736974:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996222592:12345-0@lo:400: 00000100:00100000:3.0:1788890887.737032:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996222592:12345-0@lo:400: Request processed in 59us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890887.737039:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788890887.737083:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996222592:0@lo:400: 00000100:00100000:1.0:1788890887.739658:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996222976:0@lo:400: 00000100:00100000:1.0:1788890887.739716:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890887.739757:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788890887.739763:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996222848:0@lo:400: 00000100:00100000:1.0:1788890887.739806:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890887.739862:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996223232:0@lo:400: 00000100:00100000:3.0:1788890887.739888:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890887.739907:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788890887.739911:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996223104:0@lo:400: 00000100:00100000:3.0:1788890887.739944:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996222976 00000100:00100000:3.0:1788890887.739956:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996222976 00000100:00100000:3.0:1788890887.739994:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996223232 00000100:00100000:3.0:1788890887.739996:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996223232 00000100:00100000:3.0:1788890887.740017:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788890887.740024:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996222976:12345-0@lo:400: 00000100:00100000:3.0:1788890887.740061:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996222976:12345-0@lo:400: Request processed in 38us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890887.740067:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788890887.740080:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788890887.740086:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996223232:12345-0@lo:400: 00000100:00100000:3.0:1788890887.740114:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996223232:12345-0@lo:400: Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890887.740119:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788890887.740138:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788890887.745882:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1cae20e00 x1875787996222976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890887.745902:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996222976:0@lo:400: 00000100:00100000:3.0:1788890887.746016:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890887.746114:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996222720 00000100:00100000:0.0:1788890887.746121:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996222720 00000100:00100000:0.0:1788890887.746189:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996222848 00000100:00100000:0.0:1788890887.746194:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996222848 00000100:00100000:0.0:1788890887.746240:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788890887.746249:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996222720:12345-0@lo:400: 00000100:00100000:0.0:1788890887.746323:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996222720:12345-0@lo:400: Request processed in 75us (10757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890887.746330:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788890887.746345:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788890887.746352:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996222848:12345-0@lo:400: 00000100:00100000:0.0:1788890887.746380:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996222848:12345-0@lo:400: Request processed in 29us (6573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890887.746387:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788890887.746424:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890887.746520:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996222848:0@lo:400: 00010000:00080000:3.0:1788890887.750286:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1cae21180 x1875787996223232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890887.750300:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788890887.750317:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996223232:0@lo:400: 00000100:00100000:3.0:1788890887.750335:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996222720:0@lo:400: 00000100:00100000:2.0:1788890887.750459:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996223104 00000100:00100000:2.0:1788890887.750466:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996223104 00000100:00100000:2.0:1788890887.750544:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788890887.750553:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996223104:12345-0@lo:400: 00000100:00100000:2.0:1788890887.750618:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996223104:12345-0@lo:400: Request processed in 67us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890887.750637:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788890887.750670:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996223104:0@lo:400: 00000100:00080000:1.0:1788890887.750914:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890888.248209:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996223360:0@lo:13: 00000100:00100000:2.0:1788890888.248661:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890888.252049:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996223360 00000100:00100000:3.0:1788890888.252063:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996223360 00000100:00100000:3.0:1788890888.252118:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788890888.252127:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996223360:12345-0@lo:13: 00002000:00000024:3.0:1788890888.252164:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890888.252283:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996223360:12345-0@lo:13: Request processed in 157us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890888.252314:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788890888.252575:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da2018fc000 x1875787996223360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890888.252595:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996223360:0@lo:13: 00010000:00010000:1.0:1788890888.310471:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890888.704293:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890888.704386:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815680 00000100:00100000:1.0:1788890888.704396:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815680 00000100:00100000:1.0:1788890888.704482:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:1.0:1788890888.704492:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:5681:x1875787987815680:12345-192.168.204.18@tcp:41: 00000004:00000024:1.0:1788890888.704533:0:6852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788890888.704603:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:5681:x1875787987815680:12345-192.168.204.18@tcp:41: Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890888.705040:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00080000:0.0:1788890888.705114:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890888.720418:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890888.720515:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815808 00000100:00100000:3.0:1788890888.720524:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815808 00000100:00100000:3.0:1788890888.720592:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:3.0:1788890888.720602:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5681:x1875787987815808:12345-192.168.204.18@tcp:13: 00002000:00000024:3.0:1788890888.720636:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890888.720695:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5681:x1875787987815808:12345-192.168.204.18@tcp:13: Request processed in 94us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890888.720703:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00080000:0.0:1788890888.721040:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890888.723564:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890888.723724:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987815936 00000100:00100000:1.0:1788890888.723733:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987815936 00000100:00100000:1.0:1788890888.723803:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:1.0:1788890888.723813:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5681:x1875787987815936:12345-192.168.204.18@tcp:13: 00002000:00000024:1.0:1788890888.723834:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890888.723904:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:5681:x1875787987815936:12345-192.168.204.18@tcp:13: Request processed in 92us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890888.723911:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00080000:0.0:1788890888.724079:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788890889.338470:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788890889.341301:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000001:00100000:1.0:1788890889.891936:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00010000:00010000:0.0:1788890890.366645:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788890890.388887:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000100:00100000:2.0:1788890890.988022:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890890.988085:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890890.988116:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890890.988154:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890890.988281:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816320 00000100:00100000:3.0:1788890890.988291:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816320 00000100:00100000:3.0:1788890890.988349:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816448 00000100:00100000:3.0:1788890890.988352:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816448 00000100:00100000:3.0:1788890890.988381:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:3.0:1788890890.988390:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987816320:12345-192.168.204.18@tcp:400: 00000100:00100000:3.0:1788890890.988453:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987816320:12345-192.168.204.18@tcp:400: Request processed in 65us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890890.988459:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:3.0:1788890890.988473:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:3.0:1788890890.988478:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987816448:12345-192.168.204.18@tcp:400: 00000100:00100000:3.0:1788890890.988496:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987816448:12345-192.168.204.18@tcp:400: Request processed in 18us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890890.988502:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00080000:2.0:1788890890.988867:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890890.988872:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890890.988991:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816192 00000100:00100000:0.0:1788890890.988996:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816192 00000100:00100000:0.0:1788890890.989044:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00100000:0.0:1788890890.989052:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987816192:12345-192.168.204.18@tcp:400: 00000100:00100000:0.0:1788890890.989084:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987816192:12345-192.168.204.18@tcp:400: Request processed in 34us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890890.989090:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00080000:3.0:1788890890.989620:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890890.989730:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816064 00000100:00100000:1.0:1788890890.989735:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816064 00000100:00100000:1.0:1788890890.990056:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 123 00000100:00100000:1.0:1788890890.990067:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:2372:x1875787987816064:12345-192.168.204.18@tcp:400: 00000100:00100000:1.0:1788890890.990111:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:2372:x1875787987816064:12345-192.168.204.18@tcp:400: Request processed in 47us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890890.990117:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 123 00000100:00100000:3.0:1788890891.320879:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996223488:0@lo:13: 00000100:00100000:3.0:1788890891.320948:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890891.321020:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996223488 00000100:00100000:3.0:1788890891.321027:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996223488 00000100:00100000:3.0:1788890891.321079:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890891.321087:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996223488:12345-0@lo:13: 00002000:00000024:3.0:1788890891.321133:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890891.321202:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996223488:12345-0@lo:13: Request processed in 104us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890891.321210:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788890891.321230:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788890891.321257:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f6ea00 x1875787996223488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890891.321277:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996223488:0@lo:13: 00010000:00010000:1.0:1788890891.389434:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890892.114205:0:8277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788890892.421519:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890892.854833:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996223872:0@lo:400: 00000100:00100000:2.0:1788890892.854935:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890892.855033:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788890892.855041:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996224000:0@lo:400: 00000100:00100000:2.0:1788890892.855085:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890892.855128:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996223872 00000100:00100000:2.0:1788890892.855138:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996223872 00000100:00100000:2.0:1788890892.855268:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788890892.855281:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996223872:12345-0@lo:400: 00000100:00100000:2.0:1788890892.855343:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996223872:12345-0@lo:400: Request processed in 65us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890892.855352:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788890892.855414:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996223872:0@lo:400: 00000100:00100000:0.0:1788890892.855690:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996223616:0@lo:400: 00000100:00100000:0.0:1788890892.855732:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890892.855767:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996224128:0@lo:400: 00000100:00100000:0.0:1788890892.855813:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890892.855838:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788890892.855846:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996223744:0@lo:400: 00000100:00100000:0.0:1788890892.855869:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890892.855886:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996224256:0@lo:400: 00000100:00100000:0.0:1788890892.855910:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890892.855936:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996224128 00000100:00100000:0.0:1788890892.855941:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996224128 00000100:00100000:0.0:1788890892.855971:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996223744 00000100:00100000:0.0:1788890892.855974:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996223744 00000100:00100000:0.0:1788890892.855990:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788890892.855998:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996224128:12345-0@lo:400: 00000100:00100000:0.0:1788890892.856038:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996224128:12345-0@lo:400: Request processed in 40us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890892.856044:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788890892.856058:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788890892.856065:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996223744:12345-0@lo:400: 00000100:00100000:0.0:1788890892.856105:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996223744:12345-0@lo:400: Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890892.856119:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788890892.856193:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996223744:0@lo:400: 00000100:00100000:0.0:1788890892.856209:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996224128:0@lo:400: 00000100:00100000:2.0:1788890892.856480:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996223616 00000100:00100000:2.0:1788890892.856485:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996223616 00000100:00100000:2.0:1788890892.856525:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788890892.856734:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996223616:12345-0@lo:400: 00000100:00100000:2.0:1788890892.856852:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996223616:12345-0@lo:400: Request processed in 122us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890892.856858:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788890892.857599:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996224000 00000100:00100000:3.0:1788890892.857608:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996224000 00000100:00100000:3.0:1788890892.857647:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996224256 00000100:00100000:3.0:1788890892.857650:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996224256 00000100:00100000:3.0:1788890892.857668:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788890892.857676:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996224000:12345-0@lo:400: 00000100:00100000:3.0:1788890892.857737:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996224000:12345-0@lo:400: Request processed in 62us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890892.857743:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788890892.857756:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788890892.857763:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996224256:12345-0@lo:400: 00000100:00100000:3.0:1788890892.857810:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996224256:12345-0@lo:400: Request processed in 48us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890892.857818:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788890892.857836:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890892.857842:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788890892.857892:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c5929180 x1875787996224000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890892.857908:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996224000:0@lo:400: 00000100:00100000:0.0:1788890892.866185:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996223616:0@lo:400: 00010000:00080000:0.0:1788890892.866248:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c5928e00 x1875787996224256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890892.866263:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996224256:0@lo:400: 00000100:00100000:2.0:1788890893.369004:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996224384:0@lo:13: 00000100:00100000:2.0:1788890893.369120:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890893.369386:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996224384 00000100:00100000:3.0:1788890893.369397:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996224384 00000100:00100000:3.0:1788890893.369459:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788890893.369471:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996224384:12345-0@lo:13: 00002000:00000024:3.0:1788890893.373347:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890893.373498:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996224384:12345-0@lo:13: Request processed in 4024us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890893.373519:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788890893.373870:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f6ea00 x1875787996224384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890893.373901:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996224384:0@lo:13: 00010000:00010000:3.0:1788890893.434529:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890894.456530:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890895.478394:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890896.111642:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890896.111678:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890896.111755:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890896.111836:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890896.111886:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816576 00000100:00100000:1.0:1788890896.111896:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816576 00000100:00100000:1.0:1788890896.111942:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 125 00000100:00100000:1.0:1788890896.111952:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:2374:x1875787987816576:12345-192.168.204.18@tcp:400: 00000100:00100000:1.0:1788890896.112054:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:2374:x1875787987816576:12345-192.168.204.18@tcp:400: Request processed in 103us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890896.112063:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 125 00000100:00100000:2.0:1788890896.119346:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816704 00000100:00100000:2.0:1788890896.119359:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816704 00000100:00100000:2.0:1788890896.119424:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:2.0:1788890896.123206:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987816704:12345-192.168.204.18@tcp:400: 00000100:00100000:2.0:1788890896.123307:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987816704:12345-192.168.204.18@tcp:400: Request processed in 124us (11551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890896.123316:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00080000:2.0:1788890896.123504:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890896.130673:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816832 00000100:00100000:3.0:1788890896.130686:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816832 00000100:00080000:3.0:1788890896.130726:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890896.130777:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987816960 00000100:00100000:3.0:1788890896.130781:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987816960 00000100:00100000:3.0:1788890896.130862:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:3.0:1788890896.130872:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987816832:12345-192.168.204.18@tcp:400: 00000100:00100000:3.0:1788890896.130951:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987816832:12345-192.168.204.18@tcp:400: Request processed in 80us (19271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890896.130971:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:3.0:1788890896.131009:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:3.0:1788890896.131016:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987816960:12345-192.168.204.18@tcp:400: 00000100:00100000:3.0:1788890896.131056:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987816960:12345-192.168.204.18@tcp:400: Request processed in 40us (19219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890896.131062:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00080000:3.0:1788890896.131077:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1788890896.274127:0:8427:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd8ef8ab0 20000000:00000080:1.0:1788890896.274142:0:8427:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9da1fa109c00 uarg=0000000000000000 20000000:01000000:1.0:1788890896.274395:0:8427:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788890896.274398:0:8427:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788890896.274401:0:8427:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788890896.274405:0:8427:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788890896.274410:0:8427:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788890896.274422:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788890896.274424:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788890896.274587:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788890896.274589:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788890896.275128:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788890896.275700:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788890896.275752:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788890896.275784:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788890896.275936:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788890896.275938:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788890896.276754:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788890896.277069:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788890896.277135:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788890896.277290:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788890896.277304:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788890896.277306:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788890896.277838:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788890896.278152:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788890896.278523:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788890896.278571:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788890896.278583:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788890896.278585:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788890896.279367:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788890896.279673:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788890896.279735:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788890896.279771:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1788890896.279786:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788890896.279802:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279819:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed0c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279827:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed36 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279834:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed60 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279840:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed6e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279847:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed7c expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279854:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed98 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279860:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3edbb expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279880:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b65 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279887:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b6c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279895:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279936:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b6c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.279951:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b6c expref: 9 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.279967:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996224512:192.168.204.18@tcp:104: 00010000:00010000:1.0:1788890896.280123:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b65 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.280133:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b65 expref: 9 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.280141:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996224640:192.168.204.18@tcp:104: 00010000:00010000:1.0:1788890896.280187:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3edbb expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.280195:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3edbb expref: 18 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.280215:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996224768:0@lo:104: 00000100:00100000:1.0:1788890896.280250:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890896.280286:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ed98 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.280294:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed98 expref: 18 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.280302:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996224896:0@lo:104: 00000100:00100000:1.0:1788890896.280318:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890896.280339:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ed7c expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.280346:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed7c expref: 18 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.280354:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225024:0@lo:104: 00000100:00100000:1.0:1788890896.280372:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788890896.280388:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ed6e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.280395:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed6e expref: 18 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.280403:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225152:0@lo:104: 00010000:00010000:1.0:1788890896.280421:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ed60 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.280438:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed60 expref: 18 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.280446:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225280:0@lo:104: 00010000:00010000:1.0:1788890896.280467:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ed36 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.280475:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed36 expref: 18 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.280482:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225408:0@lo:104: 00010000:00010000:1.0:1788890896.280499:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ed0c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.280507:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed0c expref: 18 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.280514:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225536:0@lo:104: 00000100:00100000:1.0:1788890896.280528:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788890896.280602:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788890896.280620:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.280643:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.280651:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.280659:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.280666:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996224768 00000100:00100000:0.0:1788890896.280672:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996224768 00000100:00100000:0.0:1788890896.280706:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996224896 00000100:00100000:0.0:1788890896.280709:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996224896 00000100:00100000:0.0:1788890896.280718:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996225024 00000100:00100000:0.0:1788890896.280721:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996225024 00000100:00100000:0.0:1788890896.280729:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996225152 00000100:00100000:0.0:1788890896.280732:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996225152 00000100:00100000:0.0:1788890896.280738:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996225280 00000100:00100000:0.0:1788890896.280740:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996225280 00000100:00100000:0.0:1788890896.280748:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996225408 00000100:00100000:0.0:1788890896.280755:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996225408 00000100:00100000:0.0:1788890896.280766:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996225536 00000100:00100000:0.0:1788890896.280768:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996225536 00000100:00100000:0.0:1788890896.280778:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890896.280786:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:8427:x1875787996224768:12345-0@lo:104: 00010000:00010000:0.0:1788890896.280797:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.280849:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788890896.280855:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+9:8427:x1875787996224768:12345-0@lo:104: Request processed in 70us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.280862:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890896.280880:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788890896.280885:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+8:8427:x1875787996224896:12345-0@lo:104: 00010000:00010000:0.0:1788890896.280893:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.280925:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890896.280930:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+8:8427:x1875787996224896:12345-0@lo:104: Request processed in 45us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.280935:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788890896.280947:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788890896.280952:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+7:8427:x1875787996225024:12345-0@lo:104: 00010000:00010000:0.0:1788890896.280959:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.280990:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788890896.280995:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+7:8427:x1875787996225024:12345-0@lo:104: Request processed in 42us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.281007:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788890896.281035:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890896.281041:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+6:8427:x1875787996225152:12345-0@lo:104: 00010000:00010000:0.0:1788890896.281049:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281073:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788890896.281078:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+6:8427:x1875787996225152:12345-0@lo:104: Request processed in 38us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.281083:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890896.281103:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788890896.281109:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+5:8427:x1875787996225280:12345-0@lo:104: 00010000:00010000:0.0:1788890896.281115:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281138:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788890896.281142:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+5:8427:x1875787996225280:12345-0@lo:104: Request processed in 34us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.281147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788890896.281157:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788890896.281161:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+4:8427:x1875787996225408:12345-0@lo:104: 00010000:00010000:0.0:1788890896.281196:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281219:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788890896.281224:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+4:8427:x1875787996225408:12345-0@lo:104: Request processed in 63us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.281235:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788890896.281245:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788890896.281251:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+3:8427:x1875787996225536:12345-0@lo:104: 00010000:00010000:0.0:1788890896.281257:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281280:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788890896.281284:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+3:8427:x1875787996225536:12345-0@lo:104: Request processed in 34us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.281290:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788890896.281304:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788890896.281310:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281317:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030200 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890896.281321:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281329:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890896.281336:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890896.281342:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890896.281368:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281373:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890896.281399:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281406:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3edbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3edc2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281419:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788890896.281422:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281427:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e600 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890896.281430:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281437:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890896.281443:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890896.281449:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890896.281459:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281465:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890896.281477:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281484:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec3ed98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed9f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281491:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788890896.281504:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281509:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c13f9c00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890896.281511:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281518:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890896.281522:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890896.281527:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890896.281539:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281545:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890896.281549:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281554:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9c00/0x9161b78f8ec3ed7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281562:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788890896.281565:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281569:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da202179400 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890896.281572:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281587:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890896.281592:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890896.281596:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890896.281609:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281614:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890896.281618:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281624:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da202179400/0x9161b78f8ec3ed6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281633:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788890896.281635:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281640:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c29efa00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890896.281642:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281648:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890896.281654:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890896.281665:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890896.281678:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281683:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890896.281687:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281693:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c29efa00/0x9161b78f8ec3ed60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed67 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281702:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788890896.281705:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281710:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c13f9400 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890896.281713:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281720:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890896.281726:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890896.281731:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890896.281741:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281747:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890896.281756:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281763:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9400/0x9161b78f8ec3ed36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed3d expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281771:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890896.281774:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281779:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c13f9e00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890896.281782:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281788:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788890896.281794:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890896.281799:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788890896.281808:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281813:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890896.281816:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281822:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c13f9e00/0x9161b78f8ec3ed0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed13 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.281833:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890896.281838:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890896.281840:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890896.281846:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890896.281852:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890896.281865:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996225664:0@lo:103: 00000100:00100000:0.0:1788890896.281901:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.281929:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996226176:0@lo:103: 00000100:00100000:0.0:1788890896.281951:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.281970:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890896.281975:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996226048:0@lo:103: 00000100:00100000:0.0:1788890896.282008:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.282035:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996225792:0@lo:103: 00000100:00100000:0.0:1788890896.282056:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.282071:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996226304:0@lo:103: 00000100:00100000:0.0:1788890896.282086:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.282107:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788890896.282112:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996225920:0@lo:103: 00000100:00100000:0.0:1788890896.282129:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.282137:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996226432:0@lo:103: 00000100:00100000:0.0:1788890896.282150:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890896.282190:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996225664 00000100:00100000:0.0:1788890896.282194:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996225664 00010000:00010000:0.0:1788890896.282214:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3edbb expref: 19 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890896.282229:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996226176 00000100:00100000:0.0:1788890896.282232:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996226176 00010000:00010000:0.0:1788890896.282240:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed60 expref: 20 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890896.282254:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996226048 00000100:00100000:0.0:1788890896.282257:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996226048 00010000:00010000:0.0:1788890896.282266:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed6e expref: 21 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890896.282275:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996225792 00000100:00100000:0.0:1788890896.282277:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996225792 00010000:00010000:0.0:1788890896.282284:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed98 expref: 22 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890896.282292:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996226304 00000100:00100000:0.0:1788890896.282294:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996226304 00010000:00010000:0.0:1788890896.282302:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed36 expref: 23 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890896.282309:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996225920 00000100:00100000:0.0:1788890896.282311:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996225920 00010000:00010000:0.0:1788890896.282319:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed7c expref: 24 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890896.282326:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996226432 00000100:00100000:0.0:1788890896.282328:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996226432 00010000:00010000:0.0:1788890896.282335:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed0c expref: 25 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890896.282346:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890896.282351:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+25:3280:x1875787996225664:12345-0@lo:103: 00010000:00010000:0.0:1788890896.282360:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890896.282365:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3edbb expref: 25 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282382:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3edbb expref: 25 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282398:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890896.282422:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+25:3280:x1875787996225664:12345-0@lo:103: Request processed in 71us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.282429:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890896.282463:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788890896.282469:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+24:3280:x1875787996226176:12345-0@lo:103: 00010000:00010000:0.0:1788890896.282475:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890896.282480:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed60 expref: 24 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282488:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed60 expref: 24 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282497:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890896.282513:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+24:3280:x1875787996226176:12345-0@lo:103: Request processed in 45us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.282518:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788890896.282528:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788890896.282533:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+23:3280:x1875787996226048:12345-0@lo:103: 00010000:00010000:0.0:1788890896.282539:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890896.282543:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed6e expref: 23 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282551:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed6e expref: 23 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282564:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890896.282582:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+23:3280:x1875787996226048:12345-0@lo:103: Request processed in 49us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.282588:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788890896.282598:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890896.282603:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+22:3281:x1875787996225792:12345-0@lo:103: 00010000:00010000:0.0:1788890896.282610:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890896.282614:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed98 expref: 22 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282621:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed98 expref: 22 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282629:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890896.282647:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+22:3281:x1875787996225792:12345-0@lo:103: Request processed in 44us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.282653:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788890896.282663:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788890896.282668:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+21:3281:x1875787996226304:12345-0@lo:103: 00010000:00010000:0.0:1788890896.282674:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890896.282678:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed36 expref: 21 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282686:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed36 expref: 21 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282694:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890896.282721:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+21:3281:x1875787996226304:12345-0@lo:103: Request processed in 53us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.282728:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788890896.282740:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788890896.282745:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+20:3281:x1875787996225920:12345-0@lo:103: 00010000:00010000:0.0:1788890896.282751:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890896.282755:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed7c expref: 20 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282763:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed7c expref: 20 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282771:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890896.282789:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+20:3281:x1875787996225920:12345-0@lo:103: Request processed in 44us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.282794:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788890896.282803:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788890896.282808:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996226432:12345-0@lo:103: 00010000:00010000:0.0:1788890896.282814:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890896.282818:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed0c expref: 19 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282825:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed0c expref: 19 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890896.282834:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890896.282850:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996226432:12345-0@lo:103: Request processed in 42us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890896.282856:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788890896.282900:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996225920:0@lo:103: 00000100:00100000:0.0:1788890896.282910:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996226432:0@lo:103: 00000100:00100000:0.0:1788890896.282916:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996225792:0@lo:103: 00000100:00100000:0.0:1788890896.282922:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996226304:0@lo:103: 00000100:00100000:0.0:1788890896.282951:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996226048:0@lo:103: 00000100:00100000:0.0:1788890896.282958:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996225664:0@lo:103: 00000100:00100000:0.0:1788890896.282964:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996226176:0@lo:103: 00010000:00010000:1.0:1788890896.283073:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3edc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3edbb expref: 18 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.283086:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996224768:0@lo:104: 00010000:00010000:1.0:1788890896.283107:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ed9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ed98 expref: 17 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.283116:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996224896:0@lo:104: 00010000:00010000:1.0:1788890896.283123:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da202179600/0x9161b78f8ec3ed83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ed7c expref: 16 pid: 5810 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.283138:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225024:0@lo:104: 00010000:00010000:1.0:1788890896.283149:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c13f8e00/0x9161b78f8ec3ed75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ed6e expref: 15 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.283156:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225152:0@lo:104: 00010000:00010000:1.0:1788890896.283164:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec3ed67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ed60 expref: 14 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.283191:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225280:0@lo:104: 00010000:00010000:1.0:1788890896.283201:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29efe00/0x9161b78f8ec3ed3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ed36 expref: 13 pid: 5808 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.283209:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225408:0@lo:104: 00010000:00010000:1.0:1788890896.283216:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c13f8800/0x9161b78f8ec3ed13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ed0c expref: 12 pid: 5807 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.283224:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996225536:0@lo:104: 00000100:00100000:0.0:1788890896.285509:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890896.285587:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996224512:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788890896.285598:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1875787996224640:192.168.204.18@tcp:104: 00010000:00010000:1.0:1788890896.285639:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890896.286037:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817088 00000100:00100000:2.0:1788890896.286044:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817088 00010000:00010000:2.0:1788890896.286075:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b6c expref: 10 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890896.286262:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890896.286676:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817216 00000100:00100000:2.0:1788890896.286681:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817216 00010000:00010000:2.0:1788890896.286700:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b65 expref: 11 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890896.286731:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:2.0:1788890896.286740:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+11:2375:x1875787987817088:12345-192.168.204.18@tcp:103: 00010000:00010000:2.0:1788890896.286763:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890896.286769:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b6c expref: 11 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.286781:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b6c expref: 11 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.286798:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3edde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b6c expref: 11 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.286828:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890896.286875:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987817088:12345-192.168.204.18@tcp:103: Request processed in 136us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890896.286884:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:2.0:1788890896.286932:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:2.0:1788890896.286939:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+9:2375:x1875787987817216:12345-192.168.204.18@tcp:103: 00010000:00010000:2.0:1788890896.286946:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890896.286950:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b65 expref: 9 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.286959:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b65 expref: 9 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.286968:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3edd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b65 expref: 9 pid: 5810 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.286979:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.286997:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.287012:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.287020:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.287027:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.287034:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.287039:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890896.287043:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.287050:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.287063:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890896.287073:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890896.287104:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+8:2375:x1875787987817216:12345-192.168.204.18@tcp:103: Request processed in 166us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890896.287110:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 19 00010000:00010000:1.0:1788890896.287657:0:8427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.287666:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890896.287681:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6f400/0x9161b78f8ec3ee16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890896.445319:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788890896.445343:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996226560:0@lo:13: 00000100:00100000:1.0:1788890896.445404:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890896.445519:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996226560 00000100:00100000:2.0:1788890896.445533:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996226560 00000100:00100000:2.0:1788890896.445592:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788890896.445601:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996226560:12345-0@lo:13: 00002000:00000024:2.0:1788890896.445634:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788890896.445681:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996226560:12345-0@lo:13: Request processed in 80us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890896.445688:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788890896.445730:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bca680 x1875787996226560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890896.445750:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996226560:0@lo:13: 00000100:00080000:1.0:1788890896.446054:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788890896.502342:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890897.527927:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788890897.657046:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788890897.657059:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1c5240800 from 39 10000000:01000000:1.0:1788890897.657078:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890897.657153:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.657203:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.657220:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890897.657253:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996226688:0@lo:101: 00000100:00100000:1.0:1788890897.657447:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.657741:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.658544:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996226688 00000100:00100000:2.0:1788890897.658557:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996226688 00000100:00100000:2.0:1788890897.658634:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788890897.658645:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+12:5812:x1875787996226688:12345-0@lo:101: 00010000:00010000:2.0:1788890897.658665:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890897.658685:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29ee600/0x9161b78f8ec3ee24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ee1d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.658716:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29ee600/0x9161b78f8ec3ee24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee1d expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.658728:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29ee600/0x9161b78f8ec3ee24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee1d expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.658740:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29ee600, rc 0) 00000100:00100000:2.0:1788890897.658822:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996226688:12345-0@lo:101: Request processed in 179us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.658830:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788890897.659115:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996226688:0@lo:101: 00010000:00010000:3.0:1788890897.659137:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890897.659147:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890897.659393:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996226816:0@lo:501: 00000100:00100000:3.0:1788890897.659508:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.659550:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9184540 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.659625:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996226816 00000100:00100000:0.0:1788890897.659631:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996226816 00000100:00100000:0.0:1788890897.659672:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788890897.659680:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996226816:12345-0@lo:501: 00000100:00100000:0.0:1788890897.660059:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996226816:12345-0@lo:501: Request processed in 377us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.660078:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788890897.660496:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996226816:0@lo:501: 00000100:00100000:3.0:1788890897.660545:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996226944:0@lo:503: 00000100:00100000:3.0:1788890897.660595:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.660627:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9184540 going to sleep for 11 seconds 00000100:00100000:1.0:1788890897.660694:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996226944 00000100:00100000:1.0:1788890897.660700:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996226944 00000100:00100000:1.0:1788890897.660746:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788890897.660755:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996226944:12345-0@lo:503: 00000100:00100000:1.0:1788890897.660935:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996226944:12345-0@lo:503: Request processed in 181us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890897.660951:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788890897.664685:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996226944:0@lo:503: 00000100:00100000:3.0:1788890897.665411:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8443:1875787996227072:0@lo:502: 00000100:00100000:3.0:1788890897.665543:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.665602:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9184f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890897.665741:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996227072 00000100:00100000:1.0:1788890897.665751:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996227072 00000100:00100000:1.0:1788890897.665820:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788890897.665833:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:8443:x1875787996227072:12345-0@lo:502: 00000100:00100000:1.0:1788890897.666251:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+13:8443:x1875787996227072:12345-0@lo:502: Request processed in 419us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890897.666260:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788890897.666704:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8443:1875787996227072:0@lo:502: 00000100:00100000:3.0:1788890897.666771:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8443:1875787996227200:0@lo:502: 00000100:00100000:3.0:1788890897.666827:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.666864:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9184f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.667112:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996227200 00000100:00100000:0.0:1788890897.667119:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996227200 00000100:00100000:0.0:1788890897.667314:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788890897.667336:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:8443:x1875787996227200:12345-0@lo:502: 00000100:00100000:0.0:1788890897.668156:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+13:8443:x1875787996227200:12345-0@lo:502: Request processed in 817us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.668166:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788890897.669029:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8443:1875787996227200:0@lo:502: 00000040:00080000:3.0:1788890897.669092:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788890897.669408:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788890897.669506:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788890897.669519:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.669532:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890897.669543:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788890897.669546:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788890897.669549:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788890897.669593:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.669601:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.669611:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890897.669632:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996227328:0@lo:101: 00000100:00100000:0.0:1788890897.669695:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.669923:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c890df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.671649:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996227328 00000100:00100000:2.0:1788890897.671678:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996227328 00000100:00100000:2.0:1788890897.671807:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788890897.671840:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+13:5812:x1875787996227328:12345-0@lo:101: 00010000:00010000:2.0:1788890897.671862:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890897.671886:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29eec00/0x9161b78f8ec3ee32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ee2b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.671937:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29eec00/0x9161b78f8ec3ee32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee2b expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.671958:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29eec00/0x9161b78f8ec3ee32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee2b expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.671968:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29eec00, rc 0) 00000100:00100000:2.0:1788890897.672051:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996227328:12345-0@lo:101: Request processed in 215us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.672058:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788890897.672196:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996227328:0@lo:101: 00010000:00010000:0.0:1788890897.672229:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.672240:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890897.672343:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996227456:0@lo:501: 00000100:00100000:0.0:1788890897.672382:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.676734:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c890df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890897.685789:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996227456 00000100:00100000:1.0:1788890897.685816:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996227456 00000100:00100000:1.0:1788890897.685971:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788890897.685984:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996227456:12345-0@lo:501: 00000100:00100000:1.0:1788890897.686812:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996227456:12345-0@lo:501: Request processed in 828us (14426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890897.686829:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788890897.688212:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996227456:0@lo:501: 00000100:00100000:0.0:1788890897.688289:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996227584:0@lo:503: 00000100:00100000:0.0:1788890897.688380:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.688548:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c890df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890897.691153:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996227584 00000100:00100000:1.0:1788890897.691183:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996227584 00000100:00100000:0.0:1788890897.691336:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788890897.691349:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996227584:12345-0@lo:503: 00000100:00100000:0.0:1788890897.691800:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996227584:12345-0@lo:503: Request processed in 452us (3418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.691817:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788890897.692002:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996227584:0@lo:503: 00000100:00100000:1.0:1788890897.692594:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8444:1875787996227712:0@lo:502: 00000100:00100000:1.0:1788890897.692652:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.692698:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.692755:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996227712 00000100:00100000:0.0:1788890897.692762:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996227712 00000100:00100000:0.0:1788890897.692856:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788890897.692866:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+14:8444:x1875787996227712:12345-0@lo:502: 00000100:00100000:0.0:1788890897.693073:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+14:8444:x1875787996227712:12345-0@lo:502: Request processed in 198us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.693081:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788890897.693159:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8444:1875787996227712:0@lo:502: 00000020:01000000:1.0:1788890897.693211:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890897.693224:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890897.693227:0:8444:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788890897.693233:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788890897.693264:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8444:1875787996227840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890897.693298:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.699617:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.700556:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996227840 00000100:00100000:2.0:1788890897.700570:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996227840 00000100:00100000:2.0:1788890897.700645:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788890897.700656:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:8444:x1875787996227840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890897.701002:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:8444:x1875787996227840:12345-0@lo:502:llog_process_th.0 Request processed in 347us (7702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.701012:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788890897.702928:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8444:1875787996227840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890897.703071:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890897.703086:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890897.703089:0:8444:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788890897.703095:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788890897.703366:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788890897.703390:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788890897.703404:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.703417:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890897.703494:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788890897.703499:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1f4e26000 from 39 10000000:01000000:1.0:1788890897.703503:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788890897.703545:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.703553:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.703563:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890897.703585:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996227968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788890897.703655:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.703710:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.703777:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996227968 00000100:00100000:2.0:1788890897.703785:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996227968 00000100:00100000:2.0:1788890897.703849:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788890897.703859:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+14:5812:x1875787996227968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890897.703887:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890897.703903:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ee40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ee39 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.703932:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ee40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee39 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.703945:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ee40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee39 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.703956:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29ef400, rc 0) 00000100:00100000:2.0:1788890897.704006:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996227968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.704013:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788890897.704215:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996227968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890897.704239:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.704249:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890897.704304:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890897.704332:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.704357:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.704440:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996228096 00000100:00100000:0.0:1788890897.704445:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996228096 00000100:00100000:0.0:1788890897.704483:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788890897.704490:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996228096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.704787:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996228096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.704795:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788890897.705081:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890897.705116:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890897.705156:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.705202:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.705329:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996228224 00000100:00100000:0.0:1788890897.705334:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996228224 00000100:00100000:0.0:1788890897.705358:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788890897.705364:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996228224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.705636:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996228224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.705643:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788890897.705718:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890897.708820:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8445:1875787996228352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890897.708942:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.708997:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9184f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.709137:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996228352 00000100:00100000:2.0:1788890897.709146:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996228352 00000100:00100000:2.0:1788890897.709247:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788890897.709259:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+15:8445:x1875787996228352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890897.709688:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+15:8445:x1875787996228352:12345-0@lo:502:llog_process_th.0 Request processed in 430us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.709698:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788890897.710120:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8445:1875787996228352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890897.710360:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8445:1875787996228480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890897.710407:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.710506:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996228480 00000100:00100000:0.0:1788890897.710512:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996228480 00000100:00100000:0.0:1788890897.710551:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788890897.710560:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:8445:x1875787996228480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890897.710724:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+15:8445:x1875787996228480:12345-0@lo:502:llog_process_th.0 Request processed in 165us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.710731:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788890897.710904:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9184f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788890897.710920:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8445:1875787996228480:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788890897.710941:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788890897.711196:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788890897.711233:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788890897.711246:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.711259:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890897.711270:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788890897.711273:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788890897.711276:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788890897.711309:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.711331:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.711342:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890897.711361:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788890897.711396:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.711417:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.711616:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996228608 00000100:00100000:0.0:1788890897.711621:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996228608 00000100:00100000:0.0:1788890897.711651:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788890897.711659:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+15:5812:x1875787996228608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890897.711669:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890897.711684:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0031c00/0x9161b78f8ec3ee4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ee47 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.711731:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0031c00/0x9161b78f8ec3ee4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee47 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.711744:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0031c00/0x9161b78f8ec3ee4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee47 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.711754:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031c00, rc 0) 00000100:00100000:0.0:1788890897.711795:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996228608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.711801:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788890897.711912:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890897.711926:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.711936:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890897.711990:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890897.712016:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.712047:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.712102:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996228736 00000100:00100000:0.0:1788890897.712106:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996228736 00000100:00100000:0.0:1788890897.712122:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788890897.712127:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996228736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.712733:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996228736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 603us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.712741:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788890897.717838:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890897.717936:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890897.718051:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890897.718121:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8ba4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.718282:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996228864 00000100:00100000:0.0:1788890897.718292:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996228864 00000100:00100000:0.0:1788890897.718359:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788890897.718372:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996228864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.718633:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996228864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.718641:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788890897.718850:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5929c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996228864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890897.720558:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5929c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8446:1875787996228992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890897.720639:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890897.720716:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8ba4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890897.728004:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996228992 00000100:00100000:3.0:1788890897.728029:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996228992 00000100:00100000:2.0:1788890897.728366:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788890897.728381:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+16:8446:x1875787996228992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890897.728818:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+16:8446:x1875787996228992:12345-0@lo:502:llog_process_th.0 Request processed in 434us (8172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.728828:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788890897.729137:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5929c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8446:1875787996228992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788890897.729209:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788890897.729222:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890897.729225:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788890897.729231:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788890897.729277:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8446:1875787996229120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890897.729338:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.729378:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9184f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.729501:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996229120 00000100:00100000:0.0:1788890897.729508:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996229120 00000100:00100000:0.0:1788890897.729561:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788890897.729569:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:8446:x1875787996229120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890897.729724:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:8446:x1875787996229120:12345-0@lo:502:llog_process_th.0 Request processed in 155us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.729731:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788890897.729818:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8446:1875787996229120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788890897.729840:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788890897.729844:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788890897.729845:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788890897.729850:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788890897.730328:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788890897.730353:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788890897.730366:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.730378:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890897.730390:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788890897.730393:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1c9db0800 from 39 10000000:01000000:0.0:1788890897.730396:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788890897.730498:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.730507:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.730518:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890897.730537:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996229248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.730582:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.730604:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf840 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.730674:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996229248 00000100:00100000:2.0:1788890897.730680:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996229248 00000100:00100000:2.0:1788890897.730720:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788890897.730728:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996229248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890897.730739:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890897.730755:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29efa00/0x9161b78f8ec3ee5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ee55 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.730782:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29efa00/0x9161b78f8ec3ee5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee55 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.730794:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29efa00/0x9161b78f8ec3ee5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee55 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.730804:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29efa00, rc 0) 00000100:00100000:2.0:1788890897.730849:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996229248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.730856:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788890897.731032:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996229248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890897.731057:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.731079:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890897.731131:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996229376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.731157:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.731213:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.731225:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996229376 00000100:00100000:0.0:1788890897.731229:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996229376 00000100:00100000:0.0:1788890897.731255:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788890897.731261:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996229376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.731589:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996229376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.731597:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788890897.731619:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996229376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.731647:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996229504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.731683:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.731693:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.731708:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996229504 00000100:00100000:0.0:1788890897.731712:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996229504 00000100:00100000:0.0:1788890897.731728:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788890897.731734:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996229504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.732689:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996229504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 950us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.732711:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788890897.738958:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996229504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.740187:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8447:1875787996229632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890897.740305:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.740364:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.740447:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996229632 00000100:00100000:2.0:1788890897.740463:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996229632 00000100:00100000:2.0:1788890897.740524:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788890897.740536:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:8447:x1875787996229632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890897.740909:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:8447:x1875787996229632:12345-0@lo:502:llog_process_th.0 Request processed in 373us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.740918:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788890897.741421:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8447:1875787996229632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890897.741508:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8447:1875787996229760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890897.741557:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.741595:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890897.741724:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996229760 00000100:00100000:0.0:1788890897.741730:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996229760 00000100:00100000:0.0:1788890897.741765:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788890897.741774:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:8447:x1875787996229760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890897.741973:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:8447:x1875787996229760:12345-0@lo:502:llog_process_th.0 Request processed in 200us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.741981:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788890897.742200:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8447:1875787996229760:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788890897.742233:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788890897.742545:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788890897.742566:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788890897.742579:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.742592:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890897.742604:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788890897.742608:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788890897.742611:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788890897.742646:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.742656:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.742680:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890897.742698:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996229888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.742734:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.742759:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c4372180 going to sleep for 11 seconds 00000100:00100000:1.0:1788890897.742807:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996229888 00000100:00100000:1.0:1788890897.742874:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996229888 00000100:00100000:1.0:1788890897.742912:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788890897.742920:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996229888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890897.742931:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890897.742946:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6f800/0x9161b78f8ec3ee6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ee63 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.742974:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6f800/0x9161b78f8ec3ee6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee63 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.742987:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6f800/0x9161b78f8ec3ee6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee63 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.742997:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f800, rc 0) 00000100:00100000:1.0:1788890897.743041:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996229888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890897.743048:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788890897.743218:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996229888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890897.743233:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.743244:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890897.743304:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996230016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.743332:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.743355:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c4372180 going to sleep for 11 seconds 00000100:00100000:1.0:1788890897.743601:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996230016 00000100:00100000:1.0:1788890897.743605:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996230016 00000100:00100000:1.0:1788890897.743677:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788890897.743685:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996230016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890897.744007:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996230016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890897.744015:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788890897.744096:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996230016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.744130:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996230144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.744191:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.757242:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c4372180 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.760599:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996230144 00000100:00100000:2.0:1788890897.760620:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996230144 00000100:00100000:2.0:1788890897.760701:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788890897.760712:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996230144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890897.765889:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996230144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5164us (21683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.765909:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788890897.767282:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996230144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890897.772652:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8448:1875787996230272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890897.772795:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.772857:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.773216:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996230272 00000100:00100000:2.0:1788890897.773227:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996230272 00000100:00100000:2.0:1788890897.773287:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788890897.773299:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8448:x1875787996230272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890897.773638:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8448:x1875787996230272:12345-0@lo:502:llog_process_th.0 Request processed in 341us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.773648:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788890897.773909:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8448:1875787996230272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890897.773949:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890897.773961:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890897.773964:0:8448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788890897.773971:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788890897.774007:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8448:1875787996230400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890897.774050:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890897.774083:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.775099:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996230400 00000100:00100000:2.0:1788890897.775110:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996230400 00000100:00100000:2.0:1788890897.775198:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788890897.775210:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8448:x1875787996230400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890897.776214:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8448:x1875787996230400:12345-0@lo:502:llog_process_th.0 Request processed in 1003us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890897.776236:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788890897.776463:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8448:1875787996230400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890897.776505:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890897.776513:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890897.776515:0:8448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788890897.776520:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788890897.777000:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788890897.777028:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788890897.777041:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.777055:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890897.777078:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788890897.777082:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9da1f024b370 from 1 10000000:01000000:2.0:1788890897.777085:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788890897.777133:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.777143:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890897.777154:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890897.777221:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996230528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788890897.777279:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890897.777319:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c32d3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788890897.777386:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996230528 00000100:00100000:1.0:1788890897.777393:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996230528 00000100:00100000:1.0:1788890897.777450:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788890897.777461:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996230528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890897.777474:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890897.777490:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6fc00/0x9161b78f8ec3ee78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ee71 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.777518:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6fc00/0x9161b78f8ec3ee78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee71 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.777531:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6fc00/0x9161b78f8ec3ee78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee71 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890897.777541:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6fc00, rc 0) 00000100:00100000:1.0:1788890897.777584:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996230528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890897.777591:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788890897.777881:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996230528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890897.777898:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.777909:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890897.777970:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996230656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890897.778001:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.778032:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c4372180 going to sleep for 11 seconds 00000100:00100000:2.0:1788890897.778090:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996230656 00000100:00100000:2.0:1788890897.778095:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996230656 00000100:00100000:2.0:1788890897.778130:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788890897.778138:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996230656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890897.778449:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996230656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (446us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788890897.778464:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788890897.778801:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996230656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788890897.778841:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788890897.778849:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890897.778858:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890897.974734:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996230912:0@lo:400:kworker.0 00000100:00100000:0.0:1788890897.974833:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890897.974930:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890897.974937:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996231040:0@lo:400:kworker.0 00000100:00100000:0.0:1788890897.974968:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.975117:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996231168:0@lo:400:kworker.0 00000100:00100000:3.0:1788890897.975153:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.975226:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788890897.975233:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996230784:0@lo:400:kworker.0 00000100:00100000:3.0:1788890897.975257:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.975271:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996231296:0@lo:400:kworker.0 00000100:00100000:3.0:1788890897.975311:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890897.975347:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996231040 00000100:00100000:3.0:1788890897.975355:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996231040 00000100:00100000:3.0:1788890897.975406:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996231296 00000100:00100000:3.0:1788890897.975409:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996231296 00000100:00100000:3.0:1788890897.975455:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890897.975465:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996231040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890897.975525:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996231040:12345-0@lo:400:kworker.0 Request processed in 61us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890897.975533:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788890897.975552:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788890897.975558:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996231296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890897.975610:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996231296:12345-0@lo:400:kworker.0 Request processed in 51us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890897.975616:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788890897.975641:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788890897.975686:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c592b800 x1875787996231296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890897.975704:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996231296:0@lo:400:kworker.0 00010000:00080000:3.0:1788890897.975732:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c592ad80 x1875787996231040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890897.975742:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996231040:0@lo:400:kworker.0 00000100:00100000:0.0:1788890897.975866:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996230912 00000100:00100000:0.0:1788890897.975871:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996230912 00000100:00100000:0.0:1788890897.975935:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996231168 00000100:00100000:0.0:1788890897.975939:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996231168 00000100:00100000:0.0:1788890897.975965:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996230784 00000100:00100000:0.0:1788890897.975969:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996230784 00000100:00100000:0.0:1788890897.975982:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788890897.975988:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996230912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890897.976024:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996230912:12345-0@lo:400:kworker.0 Request processed in 37us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.976031:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788890897.976042:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788890897.976048:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996231168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890897.976090:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996231168:12345-0@lo:400:kworker.0 Request processed in 41us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.976096:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788890897.976108:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788890897.976114:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996230784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890897.976138:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996230784:12345-0@lo:400:kworker.0 Request processed in 25us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890897.976144:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788890897.976443:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890897.976466:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996230784:0@lo:400:kworker.0 00000100:00100000:3.0:1788890897.976477:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996231168:0@lo:400:kworker.0 00000100:00100000:3.0:1788890897.976502:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996230912:0@lo:400:kworker.0 00000100:00100000:1.0:1788890898.487164:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890898.487220:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996231424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890898.487286:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890898.487465:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996231424 00000100:00100000:2.0:1788890898.487473:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996231424 00000100:00100000:2.0:1788890898.487530:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788890898.487540:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996231424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788890898.487577:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788890898.487638:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996231424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890898.487645:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788890898.487817:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f6d880 x1875787996231424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890898.487837:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996231424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890898.550411:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890899.574769:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890900.598756:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890901.227277:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890901.227338:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890901.227388:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890901.227415:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817472 00000100:00100000:1.0:1788890901.227433:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817472 00000100:00100000:3.0:1788890901.227507:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817728 00000100:00100000:3.0:1788890901.227518:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817728 00000100:00100000:1.0:1788890901.227549:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:1.0:1788890901.227565:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2373:x1875787987817472:12345-192.168.204.18@tcp:400: 00000100:00100000:3.0:1788890901.227586:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:3.0:1788890901.227600:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987817728:12345-192.168.204.18@tcp:400: 00000100:00100000:1.0:1788890901.227677:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2373:x1875787987817472:12345-192.168.204.18@tcp:400: Request processed in 115us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890901.227685:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00080000:1.0:1788890901.227713:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788890901.227719:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890901.227778:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817344 00000100:00100000:2.0:1788890901.227785:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817344 00000100:00100000:2.0:1788890901.227824:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 158 00000100:00100000:2.0:1788890901.227833:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+8:2373:x1875787987817344:12345-192.168.204.18@tcp:400: 00000100:00100000:3.0:1788890901.228613:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987817728:12345-192.168.204.18@tcp:400: Request processed in 1013us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890901.228624:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:0.0:1788890901.235654:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890901.237689:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817600 00000100:00100000:1.0:1788890901.237712:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817600 00000100:00100000:1.0:1788890901.237799:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:1.0:1788890901.237815:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987817600:12345-192.168.204.18@tcp:400: 00000100:00100000:1.0:1788890901.237919:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987817600:12345-192.168.204.18@tcp:400: Request processed in 109us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890901.237927:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00080000:0.0:1788890901.238606:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890901.242634:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+8:2373:x1875787987817344:12345-192.168.204.18@tcp:400: Request processed in 14781us (15225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890901.242655:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 158 00000100:00100000:3.0:1788890901.558791:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788890901.558825:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996231552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890901.558948:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890901.559749:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996231552 00000100:00100000:2.0:1788890901.559762:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996231552 00000100:00100000:2.0:1788890901.559861:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788890901.559874:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996231552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788890901.559924:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788890901.560020:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996231552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890901.560028:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788890901.560241:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bca300 x1875787996231552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890901.560271:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996231552:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788890901.561237:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788890901.623796:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890901.739017:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890901.739281:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817856 00000100:00100000:3.0:1788890901.739293:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817856 00000100:00100000:3.0:1788890901.739395:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 159 00000100:00100000:3.0:1788890901.739405:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+8:5603:x1875787987817856:12345-192.168.204.18@tcp:101: 00010000:00010000:3.0:1788890901.739422:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890901.739444:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1f4edc600/0x9161b78f8ec3ee7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1bce expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890901.739479:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1f4edc600/0x9161b78f8ec3ee7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bce expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890901.739489:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1f4edc600/0x9161b78f8ec3ee7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bce expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890901.739499:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc600, rc 0) 00000100:00100000:3.0:1788890901.739573:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+9:5603:x1875787987817856:12345-192.168.204.18@tcp:101: Request processed in 169us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890901.739589:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 159 00000100:00100000:1.0:1788890901.744431:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890901.744701:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987817984 00000100:00100000:2.0:1788890901.744712:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987817984 00000100:00100000:2.0:1788890901.745103:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 160 00000100:00100000:2.0:1788890901.745115:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+9:5603:x1875787987817984:12345-192.168.204.18@tcp:501: 00000100:00100000:2.0:1788890901.745464:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+9:5603:x1875787987817984:12345-192.168.204.18@tcp:501: Request processed in 350us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890901.745473:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 160 00000100:00100000:2.0:1788890901.770289:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890901.770495:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818112 00000100:00100000:3.0:1788890901.770508:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818112 00000100:00100000:0.0:1788890901.770679:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 161 00000100:00100000:0.0:1788890901.770692:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+9:5603:x1875787987818112:12345-192.168.204.18@tcp:503: 00000100:00100000:0.0:1788890901.770953:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+9:5603:x1875787987818112:12345-192.168.204.18@tcp:503: Request processed in 264us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890901.770962:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 161 00000100:00100000:1.0:1788890901.780100:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890901.780731:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818240 00000100:00100000:2.0:1788890901.780751:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818240 00000100:00100000:2.0:1788890901.780811:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 162 00000100:00100000:2.0:1788890901.780823:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+9:6096:x1875787987818240:12345-192.168.204.18@tcp:502: 00000100:00100000:2.0:1788890901.781139:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+9:6096:x1875787987818240:12345-192.168.204.18@tcp:502: Request processed in 318us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890901.782422:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 162 00000100:00100000:1.0:1788890901.796776:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890901.798898:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818368 00000100:00100000:3.0:1788890901.798919:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818368 00000100:00100000:3.0:1788890901.799013:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 163 00000100:00100000:3.0:1788890901.799025:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+9:6096:x1875787987818368:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788890901.799393:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+9:6096:x1875787987818368:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 368us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890901.799402:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 163 00000100:00100000:3.0:1788890901.814484:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890901.820369:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818496 00000100:00100000:2.0:1788890901.820384:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818496 00000100:00100000:2.0:1788890901.820466:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 164 00000100:00100000:2.0:1788890901.820480:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+9:5603:x1875787987818496:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890901.820496:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890901.820521:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ee86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1bd5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890901.820772:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ee86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bd5 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890901.820795:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ee86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bd5 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890901.821037:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29ef200, rc 0) 00000100:00100000:2.0:1788890901.821104:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:5603:x1875787987818496:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 Request processed in 628us (6630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890901.821118:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 164 00000100:00100000:1.0:1788890901.826459:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890901.826760:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818624 00000100:00100000:0.0:1788890901.826772:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818624 00000100:00100000:0.0:1788890901.826830:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 165 00000100:00100000:0.0:1788890901.826841:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:5603:x1875787987818624:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890901.827151:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:5603:x1875787987818624:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 Request processed in 311us (701us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788890901.827194:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 165 00010000:00010000:0.0:1788890902.646550:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788890902.986553:0:8487:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb7ef86d0 20000000:00000080:1.0:1788890902.986571:0:8487:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9da1c3717800 uarg=0000000000000000 20000000:01000000:1.0:1788890902.986632:0:8487:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788890902.986638:0:8487:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788890902.986644:0:8487:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788890902.993002:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788890902.996543:0:8487:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788890903.009276:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788890903.009381:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788890903.009454:0:8487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788890903.009475:0:8487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788890903.009497:0:8487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009517:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c29eea00/0x9161b78f8ec3ec56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ec4f expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009524:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eccd expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009531:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ed28 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009556:0:8487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b9d expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009564:0:8487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009606:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b9d expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009622:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b9d expref: 9 pid: 5810 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890903.009637:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1875787996231680:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890903.009752:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ed28 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009761:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed28 expref: 18 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890903.009771:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1875787996231808:0@lo:104: 00000100:00100000:0.0:1788890903.009826:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890903.009858:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3eccd expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009868:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3eccd expref: 18 pid: 5808 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890903.009876:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1875787996231936:0@lo:104: 00000100:00100000:0.0:1788890903.009907:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890903.009941:0:8487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c29eea00/0x9161b78f8ec3ec56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ec4f expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.009950:0:8487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c29eea00/0x9161b78f8ec3ec56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec4f expref: 18 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890903.009969:0:8487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1875787996232064:0@lo:104: 00000100:00100000:0.0:1788890903.009992:0:8487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890903.010007:0:8487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788890903.010103:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788890903.010117:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996231808 00000100:00100000:3.0:1788890903.010124:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996231808 00000100:00100000:3.0:1788890903.010206:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996231936 00000100:00100000:3.0:1788890903.010210:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996231936 00000100:00100000:3.0:1788890903.010221:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996232064 00000100:00100000:3.0:1788890903.010223:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996232064 00000100:00100000:3.0:1788890903.010236:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788890903.010244:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+5:8487:x1875787996231808:12345-0@lo:104: 00010000:00010000:3.0:1788890903.010257:0:6677:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010310:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788890903.010317:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+5:8487:x1875787996231808:12345-0@lo:104: Request processed in 73us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890903.010324:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788890903.010340:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788890903.010347:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+4:8487:x1875787996231936:12345-0@lo:104: 00010000:00010000:3.0:1788890903.010354:0:6677:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010387:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788890903.010391:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+4:8487:x1875787996231936:12345-0@lo:104: Request processed in 46us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890903.010398:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788890903.010410:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788890903.010417:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+3:8487:x1875787996232064:12345-0@lo:104: 00010000:00010000:3.0:1788890903.010434:0:6677:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010466:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788890903.010472:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+3:8487:x1875787996232064:12345-0@lo:104: Request processed in 56us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890903.010478:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788890903.010515:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788890903.010520:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010528:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da202179e00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:3.0:1788890903.010533:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010542:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788890903.010549:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890903.010555:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788890903.010581:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010589:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788890903.010609:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010617:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da202179e00/0x9161b78f8ec3ed28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ed2f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010635:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788890903.010639:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010645:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da202178600 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:3.0:1788890903.010648:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010656:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788890903.010662:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890903.010668:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788890903.010680:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010685:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788890903.010691:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010696:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da202178600/0x9161b78f8ec3eccd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ecd4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010706:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890903.010709:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010725:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da202179800 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:3.0:1788890903.010728:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010736:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788890903.010743:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890903.010748:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788890903.010760:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010766:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788890903.010781:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010788:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da202179800/0x9161b78f8ec3ec4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ec56 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.010817:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890903.010819:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890903.010820:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890903.010827:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890903.010832:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890903.010844:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996232192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788890903.010877:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890903.010901:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890903.010913:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996232320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788890903.010935:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890903.010972:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996232448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788890903.010993:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890903.011023:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996232192 00000100:00100000:3.0:1788890903.011027:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996232192 00010000:00010000:3.0:1788890903.011044:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed28 expref: 19 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890903.011067:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996232320 00000100:00100000:3.0:1788890903.011071:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996232320 00010000:00010000:3.0:1788890903.011082:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eccd expref: 20 pid: 5808 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890903.011092:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996232448 00000100:00100000:3.0:1788890903.011095:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996232448 00010000:00010000:3.0:1788890903.011103:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c29eea00/0x9161b78f8ec3ec56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec4f expref: 21 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890903.011115:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788890903.011121:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+21:3279:x1875787996232192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788890903.011131:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890903.011136:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed28 expref: 21 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.011145:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ed28 expref: 21 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.011160:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890903.011208:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+21:3279:x1875787996232192:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890903.011221:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788890903.011235:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788890903.011241:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+20:3279:x1875787996232320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788890903.011248:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890903.011253:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eccd expref: 20 pid: 5808 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.011261:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3eccd expref: 20 pid: 5808 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.011270:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890903.011292:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+20:3279:x1875787996232320:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890903.011298:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788890903.011310:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788890903.011316:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996232448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788890903.011322:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890903.011327:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c29eea00/0x9161b78f8ec3ec56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec4f expref: 19 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.011336:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c29eea00/0x9161b78f8ec3ec56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ec4f expref: 19 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890903.011345:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890903.011370:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996232448:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890903.011376:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788890903.011414:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996232448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788890903.011447:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996232320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788890903.011454:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996232192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788890903.012554:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da202178e00/0x9161b78f8ec3ed2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ed28 expref: 18 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890903.012578:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1875787996231808:0@lo:104: 00010000:00010000:0.0:1788890903.012590:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29eee00/0x9161b78f8ec3ecd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3eccd expref: 17 pid: 5808 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890903.012598:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1875787996231936:0@lo:104: 00010000:00010000:0.0:1788890903.012607:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29eea00/0x9161b78f8ec3ec56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ec4f expref: 16 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890903.012614:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1875787996232064:0@lo:104: 00000100:00100000:3.0:1788890903.018027:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890903.018093:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818752 00000100:00100000:2.0:1788890903.018103:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818752 00010000:00010000:2.0:1788890903.018152:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b9d expref: 10 pid: 5810 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890903.018202:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:2.0:1788890903.018212:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47df6031-18d1-4179-91e9-917028d5aced+10:2374:x1875787987818752:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890903.018228:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890903.018235:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b9d expref: 10 pid: 5810 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018248:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b9d expref: 10 pid: 5810 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018270:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018279:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018295:0:6679:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018302:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018322:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018329:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018335:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890903.018339:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018347:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018356:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.018366:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890903.018424:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47df6031-18d1-4179-91e9-917028d5aced+10:2374:x1875787987818752:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 213us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890903.018432:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 23 00010000:00010000:0.0:1788890903.020190:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3edec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b9d expref: 9 pid: 5810 timeout: 226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890903.020210:0:8487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8487:1875787996231680:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890903.020241:0:8487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.020271:0:8487:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.020278:0:8487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890903.020284:0:8487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3ee8d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890903.099292:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996232576:0@lo:400:kworker.0 00000100:00100000:3.0:1788890903.099363:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890903.099429:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996233088:0@lo:400:kworker.0 00000100:00100000:3.0:1788890903.099455:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890903.099486:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788890903.099492:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996232960:0@lo:400:kworker.0 00000100:00100000:3.0:1788890903.099514:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890903.099544:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996232704:0@lo:400:kworker.0 00000100:00100000:3.0:1788890903.099568:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890903.099586:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890903.099592:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996232832:0@lo:400:kworker.0 00000100:00100000:3.0:1788890903.099614:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890903.099643:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996233088 00000100:00100000:3.0:1788890903.099650:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996233088 00000100:00100000:3.0:1788890903.099697:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996232832 00000100:00100000:3.0:1788890903.099700:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996232832 00000100:00100000:1.0:1788890903.099711:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996232576 00000100:00100000:1.0:1788890903.099715:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996232576 00000100:00100000:1.0:1788890903.099741:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996232960 00000100:00100000:1.0:1788890903.099744:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996232960 00000100:00100000:1.0:1788890903.099756:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996232704 00000100:00100000:1.0:1788890903.099758:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996232704 00000100:00100000:1.0:1788890903.099775:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788890903.099783:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996232576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890903.099843:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996232576:12345-0@lo:400:kworker.0 Request processed in 60us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890903.099850:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788890903.099868:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788890903.099873:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996232960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890903.099898:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996232960:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890903.099903:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788890903.099913:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788890903.099919:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996232704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890903.099946:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996232704:12345-0@lo:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890903.099974:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788890903.099998:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788890903.100006:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996233088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890903.100037:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996233088:12345-0@lo:400:kworker.0 Request processed in 33us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890903.100043:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788890903.100057:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788890903.100063:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996232832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890903.100088:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996232832:12345-0@lo:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890903.100093:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788890903.102878:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788890903.102888:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788890903.102891:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788890903.102944:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996232960:0@lo:400:kworker.0 00000100:00100000:3.0:1788890903.102975:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996232576:0@lo:400:kworker.0 00010000:00080000:3.0:1788890903.102993:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcb480 x1875787996233088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890903.103010:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996233088:0@lo:400:kworker.0 00010000:00080000:3.0:1788890903.103057:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcaa00 x1875787996232832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890903.103067:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996232832:0@lo:400:kworker.0 00000100:00100000:3.0:1788890903.103077:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996232704:0@lo:400:kworker.0 00000100:00100000:1.0:1788890903.595942:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890903.596044:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987818880 00000100:00100000:2.0:1788890903.596055:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987818880 00000100:00100000:2.0:1788890903.596112:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 166 00000100:00100000:2.0:1788890903.596129:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+9:5603:x1875787987818880:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890903.596147:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890903.596408:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1bdc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.596438:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bdc expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.596459:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bdc expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890903.596469:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86200, rc 0) 00000100:00100000:2.0:1788890903.596523:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:5603:x1875787987818880:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 Request processed in 402us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890903.596529:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 166 00000100:00100000:0.0:1788890903.610703:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996233216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890903.610765:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890903.610883:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996233216 00000100:00100000:3.0:1788890903.610891:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996233216 00000100:00100000:3.0:1788890903.610938:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788890903.610958:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996233216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890903.610993:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890903.611038:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996233216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890903.611044:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788890903.611076:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0263800 x1875787996233216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890903.611093:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996233216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788890903.611541:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890903.611608:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819008 00000100:00100000:3.0:1788890903.611613:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819008 00000100:00100000:3.0:1788890903.611651:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 167 00000100:00100000:3.0:1788890903.611658:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:5603:x1875787987819008:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890903.612007:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:5603:x1875787987819008:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 Request processed in 347us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890903.612014:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 167 00000100:00100000:3.0:1788890903.629025:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890903.629273:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819136 00000100:00100000:2.0:1788890903.629283:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819136 00000100:00100000:2.0:1788890903.629407:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 168 00000100:00100000:2.0:1788890903.629418:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:5603:x1875787987819136:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890903.634667:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:5603:x1875787987819136:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 Request processed in 5238us (5641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890903.634681:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 168 00000100:00100000:2.0:1788890903.650915:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890903.651073:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819264 00000100:00100000:0.0:1788890903.651083:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819264 00000100:00100000:0.0:1788890903.651151:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 169 00000100:00100000:0.0:1788890903.651162:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:6152:x1875787987819264:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788890903.651611:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:6152:x1875787987819264:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 449us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890903.651619:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 169 00000100:00100000:0.0:1788890903.665479:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890903.679214:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819392 00000100:00100000:2.0:1788890903.679230:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819392 00000100:00100000:2.0:1788890903.679290:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 170 00000100:00100000:2.0:1788890903.679301:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:6152:x1875787987819392:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788890903.679568:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:6152:x1875787987819392:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 268us (14098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890903.679576:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 170 00010000:00010000:3.0:1788890903.685545:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788890904.440088:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788890904.440097:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1c5240800 from 4 10000000:01000000:1.0:1788890904.440103:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788890904.440161:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.440215:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.440228:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890904.440257:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996233344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788890904.440331:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890904.440380:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c890db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890904.440414:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996233344 00000100:00100000:1.0:1788890904.440421:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996233344 00000100:00100000:1.0:1788890904.440469:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788890904.440478:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996233344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890904.440491:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890904.440503:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ee9b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.440527:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee9b expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.440538:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee9b expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.440548:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6fe00, rc 0) 00000100:00100000:1.0:1788890904.440587:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996233344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.440594:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788890904.440646:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996233344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890904.440659:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.440668:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890904.440720:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996233472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890904.440744:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890904.440759:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c890db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890904.440779:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996233472 00000100:00100000:1.0:1788890904.440783:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996233472 00000100:00100000:1.0:1788890904.440806:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788890904.440812:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996233472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890904.441093:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996233472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.441100:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788890904.441133:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996233472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890904.441160:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996233600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890904.441218:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890904.441231:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201a063c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890904.441242:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996233600 00000100:00100000:1.0:1788890904.441246:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996233600 00000100:00100000:1.0:1788890904.441264:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788890904.441269:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996233600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890904.441401:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996233600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.441407:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788890904.441456:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996233600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890904.462190:0:8550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8550:1875787996233728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890904.462283:0:8550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890904.462333:0:8550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41cd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788890904.462566:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996233728 00000100:00100000:1.0:1788890904.462574:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996233728 00000100:00100000:1.0:1788890904.462623:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788890904.462631:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:8550:x1875787996233728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890904.463031:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:8550:x1875787996233728:12345-0@lo:502:llog_process_th.0 Request processed in 399us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.463048:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788890904.472342:0:8550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8550:1875787996233728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788890904.472841:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890904.472856:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890904.472858:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788890904.472866:0:8550:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1c5240800 00000020:00000080:2.0:1788890904.472869:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788890904.472970:0:8550:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8550:1875787996233856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890904.473052:0:8550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890904.473097:0:8550:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c51aea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890904.476345:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996233856 00000100:00100000:1.0:1788890904.476357:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996233856 00000100:00100000:1.0:1788890904.476413:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788890904.476423:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:8550:x1875787996233856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890904.476690:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:8550:x1875787996233856:12345-0@lo:502:llog_process_th.0 Request processed in 268us (3638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.476697:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788890904.479247:0:8550:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8550:1875787996233856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788890904.479292:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890904.479299:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890904.479302:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788890904.479308:0:8550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788890904.483438:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788890904.483471:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890904.483481:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.483495:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890904.483505:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788890904.483507:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1f4e26000 from 4 10000000:01000000:1.0:1788890904.483510:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788890904.483547:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.483554:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.483566:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890904.483592:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996233984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788890904.483663:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890904.484215:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201a06000 going to sleep for 11 seconds 00000100:00100000:1.0:1788890904.484235:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996233984 00000100:00100000:1.0:1788890904.484242:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996233984 00000100:00100000:1.0:1788890904.484285:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788890904.484293:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996233984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890904.484464:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890904.484477:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3eea9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.484504:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3eea9 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.484515:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eea9 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890904.484523:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f000, rc 0) 00000100:00100000:1.0:1788890904.484609:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996233984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 316us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890904.484617:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788890904.491218:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996233984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890904.491246:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.491259:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890904.491350:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.491402:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.491439:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890904.491591:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996234112 00000100:00100000:2.0:1788890904.491598:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996234112 00000100:00100000:2.0:1788890904.491634:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788890904.491643:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996234112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890904.491878:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996234112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890904.491886:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788890904.494056:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.494131:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.494299:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.494334:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890904.494365:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996234240 00000100:00100000:0.0:1788890904.494370:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996234240 00000100:00100000:0.0:1788890904.494415:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788890904.494425:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996234240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.494632:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996234240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890904.494640:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788890904.494693:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.503687:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8555:1875787996234368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890904.503777:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.503823:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996234368 00000100:00100000:0.0:1788890904.503831:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996234368 00000100:00100000:0.0:1788890904.503879:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788890904.503887:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8555:x1875787996234368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890904.504122:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8555:x1875787996234368:12345-0@lo:502:llog_process_th.0 Request processed in 234us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890904.504138:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788890904.504223:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890904.504245:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8555:1875787996234368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890904.504279:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890904.504289:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890904.504291:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788890904.504298:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1f4e26000 00000020:00000080:0.0:1788890904.504301:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788890904.504775:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8555:1875787996234496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890904.504818:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.504844:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996234496 00000100:00100000:0.0:1788890904.504849:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996234496 00000100:00100000:0.0:1788890904.504879:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788890904.504885:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8555:x1875787996234496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890904.505038:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:8555:x1875787996234496:12345-0@lo:502:llog_process_th.0 Request processed in 152us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890904.505045:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788890904.505084:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890904.505099:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8555:1875787996234496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890904.505124:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890904.505129:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890904.505131:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788890904.505136:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788890904.505247:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788890904.505264:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788890904.505273:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.505290:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890904.505300:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788890904.505302:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1c9db0800 from 4 10000000:01000000:0.0:1788890904.505306:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788890904.505332:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.505339:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.505348:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890904.505362:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.505388:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.505408:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890904.505422:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996234624 00000100:00100000:0.0:1788890904.505426:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996234624 00000100:00100000:0.0:1788890904.505448:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788890904.505454:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996234624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890904.505463:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890904.505474:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3eeb7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.505497:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3eeb7 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.505519:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eeb7 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.505528:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030a00, rc 0) 00000100:00100000:0.0:1788890904.505558:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996234624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890904.505564:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788890904.505595:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890904.505607:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.505615:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890904.505655:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.509231:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.509295:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890904.509325:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996234752 00000100:00100000:0.0:1788890904.509333:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996234752 00000100:00100000:0.0:1788890904.509385:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788890904.509394:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996234752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.512410:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996234752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3010us (6723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890904.512424:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788890904.512522:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.512589:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.512634:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890904.512663:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788890904.512677:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996234880 00000100:00100000:0.0:1788890904.512682:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996234880 00000100:00100000:0.0:1788890904.512716:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788890904.512724:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996234880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890904.512909:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996234880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890904.512915:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788890904.512965:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996234880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890904.517539:0:8557:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8557:1875787996235008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890904.517627:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890904.518146:0:8557:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c51aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890904.518698:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996235008 00000100:00100000:0.0:1788890904.518707:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996235008 00000100:00100000:0.0:1788890904.518781:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788890904.518790:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:8557:x1875787996235008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890904.520128:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:8557:x1875787996235008:12345-0@lo:502:llog_process_th.0 Request processed in 1334us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890904.520139:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788890904.521882:0:8557:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8557:1875787996235008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788890904.521951:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788890904.521963:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890904.521966:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788890904.521977:0:8557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1c9db0800 00000020:00000080:2.0:1788890904.521980:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788890904.522421:0:8557:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8557:1875787996235136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788890904.522482:0:8557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890904.522518:0:8557:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c9ab1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788890904.523048:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996235136 00000100:00100000:0.0:1788890904.523056:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996235136 00000100:00100000:0.0:1788890904.523102:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788890904.523111:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:8557:x1875787996235136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890904.523461:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:8557:x1875787996235136:12345-0@lo:502:llog_process_th.0 Request processed in 350us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890904.523472:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788890904.523821:0:8557:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:8557:1875787996235136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788890904.523855:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788890904.523862:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788890904.523864:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788890904.523869:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788890904.524415:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788890904.524438:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788890904.524448:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.524459:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890904.694357:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890905.718468:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890906.349472:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890906.349509:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890906.349540:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890906.349568:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890906.349598:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819776 00000100:00100000:0.0:1788890906.349608:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819776 00000100:00100000:0.0:1788890906.349663:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819904 00000100:00100000:0.0:1788890906.349667:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819904 00000100:00100000:0.0:1788890906.349687:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:0.0:1788890906.349697:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987819776:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890906.349774:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987819776:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 79us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890906.349782:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:0.0:1788890906.349799:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:0.0:1788890906.349806:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987819904:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890906.349827:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987819904:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 22us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890906.349846:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00080000:0.0:1788890906.349873:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788890906.349876:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890906.350201:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819520 00000100:00100000:2.0:1788890906.350205:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819520 00000100:00100000:2.0:1788890906.350236:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 186 00000100:00100000:2.0:1788890906.350244:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:2372:x1875787987819520:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890906.350276:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:2372:x1875787987819520:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 34us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890906.350282:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 186 00000100:00100000:2.0:1788890906.353890:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987819648 00000100:00100000:2.0:1788890906.353911:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987819648 00000100:00100000:2.0:1788890906.353990:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:2.0:1788890906.354000:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987819648:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890906.354081:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987819648:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 82us (4540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890906.354088:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00080000:0.0:1788890906.354157:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890906.680574:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890906.680603:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996235264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890906.680673:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890906.680784:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996235264 00000100:00100000:1.0:1788890906.680793:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996235264 00000100:00100000:1.0:1788890906.680871:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788890906.680881:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996235264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788890906.680929:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890906.680978:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996235264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890906.680985:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788890906.681043:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bc8000 x1875787996235264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890906.681079:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996235264:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788890906.681267:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788890906.751866:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890907.767999:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890908.214433:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996235392:0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.214507:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890908.214561:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996235904:0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.214588:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890908.214616:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788890908.214622:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996235520:0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.214645:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890908.214663:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996236032:0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.214686:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890908.214712:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996235648:0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.214736:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890908.214756:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890908.214760:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996235776:0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.214779:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890908.214806:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996235904 00000100:00100000:1.0:1788890908.214812:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996235904 00000100:00100000:1.0:1788890908.214884:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996235520 00000100:00100000:1.0:1788890908.214888:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996235520 00000100:00100000:1.0:1788890908.214901:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996235648 00000100:00100000:1.0:1788890908.214904:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996235648 00000100:00100000:1.0:1788890908.214919:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788890908.214927:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996235904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.214979:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996235904:12345-0@lo:400:kworker.0 Request processed in 52us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890908.214997:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788890908.215016:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890908.215022:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996235520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.215060:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996235520:12345-0@lo:400:kworker.0 Request processed in 38us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890908.215066:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788890908.215075:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788890908.215080:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996235648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.215103:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996235648:12345-0@lo:400:kworker.0 Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890908.215109:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788890908.215147:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996235648:0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.215194:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996235520:0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.215204:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996235904:0@lo:400:kworker.0 00000100:00100000:0.0:1788890908.219383:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996235392 00000100:00100000:0.0:1788890908.219398:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996235392 00000100:00100000:0.0:1788890908.219472:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788890908.219482:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996235392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890908.219573:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996235392:12345-0@lo:400:kworker.0 Request processed in 93us (5065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890908.219581:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788890908.219619:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996236032 00000100:00100000:0.0:1788890908.219623:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996236032 00000100:00100000:0.0:1788890908.219655:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996235776 00000100:00100000:0.0:1788890908.219658:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996235776 00000100:00100000:0.0:1788890908.219673:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788890908.219679:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996236032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890908.219713:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996236032:12345-0@lo:400:kworker.0 Request processed in 33us (5026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890908.219718:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788890908.219729:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788890908.219735:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996235776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890908.219765:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996235776:12345-0@lo:400:kworker.0 Request processed in 30us (4985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890908.219770:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788890908.219803:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788890908.219808:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788890908.219811:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788890908.223343:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcbb80 x1875787996235776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890908.223363:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996235776:0@lo:400:kworker.0 00010000:00080000:1.0:1788890908.223403:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcaa00 x1875787996236032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890908.223429:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996236032:0@lo:400:kworker.0 00000100:00100000:1.0:1788890908.223442:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996235392:0@lo:400:kworker.0 00000100:00100000:0.0:1788890908.726355:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996236160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890908.726428:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890908.727401:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996236160 00000100:00100000:0.0:1788890908.727411:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996236160 00000100:00100000:0.0:1788890908.727483:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788890908.727494:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996236160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788890908.727537:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788890908.727599:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996236160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890908.727606:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788890908.727647:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0263800 x1875787996236160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890908.727667:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996236160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788890908.790334:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890909.618582:0:8787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788890909.820455:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890910.838589:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890911.468368:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890911.468471:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890911.468606:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820032 00000100:00100000:3.0:1788890911.468615:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820032 00000100:00100000:3.0:1788890911.468668:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 188 00000100:00100000:3.0:1788890911.468677:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987820032:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788890911.468743:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987820032:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 68us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890911.468751:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 188 00000100:00100000:2.0:1788890911.468881:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820160 00000100:00100000:2.0:1788890911.468886:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820160 00000100:00100000:2.0:1788890911.468940:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 31 00000100:00100000:2.0:1788890911.468947:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987820160:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890911.468978:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987820160:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890911.468985:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 31 00000100:00080000:3.0:1788890911.469116:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890911.473295:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890911.473408:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890911.473541:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820288 00000100:00100000:1.0:1788890911.473567:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820288 00000100:00100000:1.0:1788890911.473643:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820416 00000100:00080000:3.0:1788890911.473647:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890911.473647:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820416 00000100:00100000:0.0:1788890911.473695:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:0.0:1788890911.473708:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2371:x1875787987820288:12345-192.168.204.18@tcp:9:kworker.0 00000020:00000080:0.0:1788890911.473751:0:6663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3edfa 00000100:00080000:0.0:1788890911.473761:0:6663:0:(import.c:65:import_set_state_nolock()) ffff9da1cae1f000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788890911.473821:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788890911.473821:0:6663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788890911.474222:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+2:2371:x1875787987820288:12345-192.168.204.18@tcp:9:kworker.0 Request processed in 517us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890911.474231:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00080000:3.0:1788890911.477783:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788890911.477915:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:1.0:1788890911.477931:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2371:x1875787987820416:12345-192.168.204.18@tcp:9:kworker.0 00000020:00000080:1.0:1788890911.477970:0:6662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ee01 00000100:00080000:1.0:1788890911.477980:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9da1cae1d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788890911.478061:0:6662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788890911.478629:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+2:2371:x1875787987820416:12345-192.168.204.18@tcp:9:kworker.0 Request processed in 701us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.478638:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 11 00010000:00010000:2.0:1788890911.479876:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890911.801648:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996236288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788890911.801723:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890911.801836:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996236288 00000100:00100000:1.0:1788890911.801843:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996236288 00000100:00100000:1.0:1788890911.801907:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788890911.801917:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996236288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788890911.801954:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890911.801998:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996236288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890911.802005:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788890911.802050:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788890911.802079:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bc8000 x1875787996236288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890911.802098:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996236288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788890911.862419:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890912.886980:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890913.334649:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996236416:0@lo:400:kworker.0 00000100:00100000:3.0:1788890913.334722:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890913.334784:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996236928:0@lo:400:kworker.0 00000100:00100000:3.0:1788890913.334811:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890913.334838:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788890913.334844:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996236544:0@lo:400:kworker.0 00000100:00100000:3.0:1788890913.334866:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890913.334883:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996237056:0@lo:400:kworker.0 00000100:00100000:3.0:1788890913.334906:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890913.334934:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996236672:0@lo:400:kworker.0 00000100:00100000:3.0:1788890913.334963:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890913.334982:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890913.334987:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996236800:0@lo:400:kworker.0 00000100:00100000:3.0:1788890913.335008:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890913.335039:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996236416 00000100:00100000:3.0:1788890913.335046:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996236416 00000100:00100000:3.0:1788890913.335091:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788890913.335100:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996236416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890913.335146:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996236416:12345-0@lo:400:kworker.0 Request processed in 48us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890913.335154:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788890913.335219:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996236928 00000100:00100000:3.0:1788890913.335224:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996236928 00000100:00100000:3.0:1788890913.335257:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996236544 00000100:00100000:3.0:1788890913.335260:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996236544 00000100:00100000:2.0:1788890913.335614:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996237056 00000100:00100000:2.0:1788890913.335619:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996237056 00000100:00100000:2.0:1788890913.335649:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996236800 00000100:00100000:2.0:1788890913.335652:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996236800 00000100:00100000:2.0:1788890913.335668:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788890913.335675:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996237056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890913.335716:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996237056:12345-0@lo:400:kworker.0 Request processed in 41us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890913.335723:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788890913.335734:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788890913.335740:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996236800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890913.335791:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996236800:12345-0@lo:400:kworker.0 Request processed in 51us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890913.335797:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788890913.335813:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996236672 00000100:00100000:2.0:1788890913.335817:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996236672 00000100:00100000:2.0:1788890913.335836:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788890913.335841:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996236928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890913.335870:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996236928:12345-0@lo:400:kworker.0 Request processed in 29us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890913.335875:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788890913.335885:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788890913.335891:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996236672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890913.335914:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996236672:12345-0@lo:400:kworker.0 Request processed in 23us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890913.335920:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788890913.335966:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f0261500 x1875787996236800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890913.335979:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996236800:0@lo:400:kworker.0 00000100:00100000:2.0:1788890913.335990:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996236672:0@lo:400:kworker.0 00010000:00080000:2.0:1788890913.336035:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da0c1ab0700 x1875787996237056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890913.336043:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996237056:0@lo:400:kworker.0 00000100:00100000:2.0:1788890913.336052:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996236416:0@lo:400:kworker.0 00000100:00100000:2.0:1788890913.336060:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996236928:0@lo:400:kworker.0 00000100:00080000:2.0:1788890913.336092:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788890913.336096:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890913.336099:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890913.336358:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788890913.336366:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996236544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890913.336416:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996236544:12345-0@lo:400:kworker.0 Request processed in 52us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890913.336422:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788890913.339396:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f0261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996236544:0@lo:400:kworker.0 00000100:00100000:0.0:1788890913.846381:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890913.846405:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996237184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890913.846472:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890913.846581:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996237184 00000100:00100000:3.0:1788890913.846589:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996237184 00000100:00100000:3.0:1788890913.846648:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788890913.846657:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996237184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890913.846692:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890913.846760:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996237184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890913.846779:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788890913.846816:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da0c1ab0a80 x1875787996237184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890913.846834:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996237184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788890913.910342:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890914.945390:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788890914.954275:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:2.0:1788890914.954285:0:7624:0:(genops.c:885:class_export_put()) final put ffff9da1cae1c800/671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:2.0:1788890914.954313:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1cae1c800/671ae218-3c0c-4db9-9d11-9d6b732a0de5 for lustre-OST0001 00000020:00000080:2.0:1788890914.954360:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1cae1d000 for lustre-OST0001 00000001:02000400:2.0:1788890915.554747:0:9032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing yml_node 00000001:00100000:2.0:1788890915.934846:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:2.0:1788890915.934855:0:6689:0:(genops.c:885:class_export_put()) final put ffff9da1cae1f800/671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:2.0:1788890915.934880:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1cae1f800/671ae218-3c0c-4db9-9d11-9d6b732a0de5 for lustre-OST0000 00000020:00000080:2.0:1788890915.934921:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1cae1f000 for lustre-OST0000 00010000:00010000:0.0:1788890915.959276:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890916.586382:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890916.586422:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890916.586458:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820544 00000100:00100000:3.0:1788890916.586469:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820544 00000100:00100000:3.0:1788890916.586523:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 190 00000100:00100000:3.0:1788890916.586534:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987820544:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788890916.586607:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987820544:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 75us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890916.586616:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 190 00000100:00100000:2.0:1788890916.587310:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820672 00000100:00100000:2.0:1788890916.587316:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820672 00000100:00100000:2.0:1788890916.587669:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 35 00000100:00100000:2.0:1788890916.587679:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987820672:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890916.587739:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987820672:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 62us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890916.587747:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 35 00000100:00080000:3.0:1788890916.592513:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890916.918456:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890916.918481:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996237312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890916.918561:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890916.918696:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996237312 00000100:00100000:1.0:1788890916.918707:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996237312 00000100:00100000:1.0:1788890916.918775:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788890916.918786:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996237312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788890916.918827:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890916.918877:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996237312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890916.918903:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788890916.919004:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788890916.919039:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcaa00 x1875787996237312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890916.919059:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996237312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788890916.986625:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890918.006777:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890918.454447:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996237824:0@lo:400:kworker.0 00000100:00100000:0.0:1788890918.454541:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890918.454611:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890918.454617:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996237696:0@lo:400:kworker.0 00000100:00100000:0.0:1788890918.454646:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890918.454788:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996237568:0@lo:400:kworker.0 00000100:00100000:3.0:1788890918.454821:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890918.454850:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996238080:0@lo:400:kworker.0 00000100:00100000:3.0:1788890918.454873:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890918.454896:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788890918.454902:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996237440:0@lo:400:kworker.0 00000100:00100000:3.0:1788890918.454928:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890918.454944:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996237952:0@lo:400:kworker.0 00000100:00100000:3.0:1788890918.454965:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890918.454994:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996237696 00000100:00100000:3.0:1788890918.455014:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996237696 00000100:00100000:3.0:1788890918.455069:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996237568 00000100:00100000:3.0:1788890918.455073:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996237568 00000100:00100000:3.0:1788890918.455087:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996237952 00000100:00100000:3.0:1788890918.455089:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996237952 00000100:00100000:3.0:1788890918.455105:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788890918.455113:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996237696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890918.455188:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996237696:12345-0@lo:400:kworker.0 Request processed in 53us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890918.455196:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788890918.455214:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788890918.455220:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996237568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890918.455251:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996237568:12345-0@lo:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890918.455258:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788890918.455270:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788890918.455275:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996237952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890918.455301:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996237952:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890918.455308:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788890918.455348:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996237952:0@lo:400:kworker.0 00000100:00100000:3.0:1788890918.455360:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996237568:0@lo:400:kworker.0 00000100:00100000:2.0:1788890918.455642:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996237824 00000100:00100000:2.0:1788890918.455647:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996237824 00000100:00100000:2.0:1788890918.455698:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996238080 00000100:00100000:2.0:1788890918.455701:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996238080 00000100:00100000:2.0:1788890918.455718:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788890918.455725:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996237824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890918.455774:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996237824:12345-0@lo:400:kworker.0 Request processed in 49us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890918.455781:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788890918.455794:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788890918.455800:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996238080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890918.455838:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996238080:12345-0@lo:400:kworker.0 Request processed in 38us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890918.455844:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788890918.455866:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996237440 00000100:00100000:2.0:1788890918.455869:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996237440 00000100:00100000:2.0:1788890918.455895:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788890918.455901:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996237440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890918.455931:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996237440:12345-0@lo:400:kworker.0 Request processed in 29us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890918.455937:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788890918.456023:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996237440:0@lo:400:kworker.0 00010000:00080000:3.0:1788890918.456036:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1d0f21c00 x1875787996238080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890918.456059:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996238080:0@lo:400:kworker.0 00000100:00080000:0.0:1788890918.456130:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788890918.456134:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788890918.456137:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890918.456156:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996237696:0@lo:400:kworker.0 00010000:00080000:0.0:1788890918.456194:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1d0f22680 x1875787996237824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890918.456202:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996237824:0@lo:400:kworker.0 00000100:00100000:0.0:1788890918.966423:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890918.966446:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996238208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890918.966519:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890918.966713:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996238208 00000100:00100000:3.0:1788890918.966720:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996238208 00000100:00100000:3.0:1788890918.966776:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788890918.966785:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996238208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890918.966820:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890918.966872:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996238208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890918.966878:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788890918.967133:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da0c1ab2a00 x1875787996238208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890918.967152:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996238208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890919.032349:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890920.054339:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890920.712732:0:9225:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:2.0:1788890921.078875:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890921.713510:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890921.713560:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890921.715073:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820800 00000100:00100000:0.0:1788890921.715086:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820800 00000100:00100000:0.0:1788890921.715521:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 192 00000100:00100000:0.0:1788890921.715533:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:2372:x1875787987820800:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890921.715759:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:2372:x1875787987820800:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 227us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890921.715767:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 192 00000100:00100000:1.0:1788890921.716052:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987820928 00000100:00100000:1.0:1788890921.716058:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987820928 00000100:00100000:1.0:1788890921.716113:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:1.0:1788890921.716122:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987820928:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890921.716158:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987820928:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 38us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890921.716190:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00080000:0.0:1788890921.716273:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890922.039866:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996238336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890922.039937:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890922.040105:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996238336 00000100:00100000:1.0:1788890922.040114:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996238336 00000100:00100000:1.0:1788890922.040196:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788890922.040207:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996238336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788890922.040240:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890922.040297:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996238336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890922.040304:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788890922.040367:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788890922.040572:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcbb80 x1875787996238336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890922.040604:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996238336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788890922.102442:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890922.743662:0:9323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:1.0:1788890923.127252:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890923.574431:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996238592:0@lo:400:kworker.0 00000100:00100000:3.0:1788890923.574502:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890923.574549:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996239104:0@lo:400:kworker.0 00000100:00100000:3.0:1788890923.574590:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890923.574623:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788890923.574629:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996238464:0@lo:400:kworker.0 00000100:00100000:3.0:1788890923.574655:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890923.574678:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996238976:0@lo:400:kworker.0 00000100:00100000:3.0:1788890923.574700:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890923.574734:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996238720:0@lo:400:kworker.0 00000100:00100000:3.0:1788890923.574758:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890923.574775:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788890923.574780:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996238848:0@lo:400:kworker.0 00000100:00100000:3.0:1788890923.574813:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890923.574850:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996238592 00000100:00100000:3.0:1788890923.574857:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996238592 00000100:00100000:3.0:1788890923.574895:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996238976 00000100:00100000:3.0:1788890923.574898:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996238976 00000100:00100000:1.0:1788890923.575018:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788890923.575028:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996238592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890923.575081:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996238592:12345-0@lo:400:kworker.0 Request processed in 55us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890923.575087:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788890923.575105:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788890923.575111:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996238976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890923.575143:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996238976:12345-0@lo:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890923.575149:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788890923.575206:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996238976:0@lo:400:kworker.0 00000100:00100000:1.0:1788890923.575216:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996238592:0@lo:400:kworker.0 00000100:00080000:0.0:1788890923.575291:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890923.575471:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996238720 00000100:00100000:3.0:1788890923.575476:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996238720 00000100:00100000:3.0:1788890923.578088:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788890923.578102:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996238720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890923.578194:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996238720:12345-0@lo:400:kworker.0 Request processed in 96us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890923.578201:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788890923.578223:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996239104 00000100:00100000:3.0:1788890923.578229:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996239104 00000100:00080000:0.0:1788890923.579530:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788890923.579537:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890923.583138:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996238848 00000100:00100000:3.0:1788890923.583150:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996238848 00000100:00100000:2.0:1788890923.587007:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890923.587027:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996239104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890923.587126:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996239104:12345-0@lo:400:kworker.0 Request processed in 106us (12535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890923.587147:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890923.587188:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788890923.587196:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996238848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890923.587228:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996238848:12345-0@lo:400:kworker.0 Request processed in 34us (12414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890923.587233:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788890923.587275:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da0c1ab3800 x1875787996239104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890923.587289:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996239104:0@lo:400:kworker.0 00000100:00100000:0.0:1788890923.590492:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996238464 00000100:00100000:0.0:1788890923.590506:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996238464 00000100:00100000:0.0:1788890923.590566:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788890923.590577:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996238464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890923.590671:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996238464:12345-0@lo:400:kworker.0 Request processed in 96us (16014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890923.590678:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00080000:0.0:1788890923.590736:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da0c1ab2d80 x1875787996238848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890923.590752:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996238848:0@lo:400:kworker.0 00000100:00100000:0.0:1788890923.590766:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996238720:0@lo:400:kworker.0 00000100:00100000:2.0:1788890923.592829:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996238464:0@lo:400:kworker.0 00000100:00100000:1.0:1788890924.088607:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788890924.088628:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996239232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890924.088697:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890924.088818:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996239232 00000100:00100000:3.0:1788890924.088826:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996239232 00000100:00100000:3.0:1788890924.088883:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788890924.088892:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996239232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890924.088933:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890924.088985:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996239232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890924.088993:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788890924.094601:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1d0757b80 x1875787996239232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890924.094628:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996239232:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788890924.151150:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890924.894567:0:9420:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:0.0:1788890925.174418:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788890926.139434:0:9468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 14:08:45 EDT 2026 00010000:00010000:2.0:1788890926.200801:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890926.826373:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890926.826416:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890926.826450:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821184 00000100:00100000:1.0:1788890926.826458:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821184 00000100:00100000:1.0:1788890926.826523:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:1.0:1788890926.826533:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987821184:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890926.826595:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987821184:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890926.826602:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00080000:1.0:1788890926.826621:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890926.826714:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821056 00000100:00100000:3.0:1788890926.826727:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821056 00000100:00100000:3.0:1788890926.826762:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 194 00000100:00100000:3.0:1788890926.826770:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987821056:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788890926.826795:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987821056:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890926.826802:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 194 00000100:00100000:3.0:1788890927.158274:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996239360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890927.158345:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890927.158421:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996239360 00000100:00100000:3.0:1788890927.158429:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996239360 00000100:00100000:3.0:1788890927.158499:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788890927.158509:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996239360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890927.158541:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788890927.158569:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890927.158593:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996239360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890927.158601:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788890927.158640:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1d0754000 x1875787996239360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890927.158658:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996239360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788890927.223304:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890928.246795:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890928.694596:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788890928.694666:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788890928.694686:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996239616:0@lo:400:kworker.0 00000100:00100000:2.0:1788890928.694753:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890928.694871:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996239616 00000100:00100000:3.0:1788890928.694879:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996239616 00000100:00100000:3.0:1788890928.694934:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788890928.694943:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996239616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890928.694994:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996239616:12345-0@lo:400:kworker.0 Request processed in 52us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890928.695017:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788890928.695136:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996239488:0@lo:400:kworker.0 00000100:00100000:0.0:1788890928.695202:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890928.695278:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996239488 00000100:00100000:3.0:1788890928.695282:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996239488 00000100:00100000:3.0:1788890928.695316:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788890928.695323:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996239488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890928.695357:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996239488:12345-0@lo:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890928.695363:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788890928.695554:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996239488:0@lo:400:kworker.0 00000100:00100000:2.0:1788890928.695645:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996239616:0@lo:400:kworker.0 00000100:00100000:0.0:1788890928.699096:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996239872:0@lo:400:kworker.0 00000100:00100000:0.0:1788890928.699207:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890928.699247:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890928.699254:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996239744:0@lo:400:kworker.0 00000100:00100000:0.0:1788890928.699279:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890928.699303:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996240128:0@lo:400:kworker.0 00000100:00100000:0.0:1788890928.699328:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890928.699347:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788890928.699353:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996240000:0@lo:400:kworker.0 00000100:00100000:0.0:1788890928.699389:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890928.699414:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996239872 00000100:00100000:0.0:1788890928.699420:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996239872 00000100:00100000:0.0:1788890928.699468:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996240128 00000100:00100000:0.0:1788890928.699471:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996240128 00000100:00100000:0.0:1788890928.699497:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788890928.699506:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996239872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890928.699552:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996239872:12345-0@lo:400:kworker.0 Request processed in 47us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890928.699560:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788890928.699576:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788890928.699582:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996240128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890928.699609:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996240128:12345-0@lo:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890928.699615:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788890928.699644:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bc9c00 x1875787996239872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890928.699658:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996239872:0@lo:400:kworker.0 00010000:00080000:0.0:1788890928.699681:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bc8700 x1875787996240128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890928.699691:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996240128:0@lo:400:kworker.0 00000100:00100000:1.0:1788890928.700006:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996239744 00000100:00100000:1.0:1788890928.700010:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996239744 00000100:00100000:1.0:1788890928.700044:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996240000 00000100:00100000:1.0:1788890928.700048:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996240000 00000100:00100000:1.0:1788890928.700074:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788890928.700081:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996239744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890928.700133:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996239744:12345-0@lo:400:kworker.0 Request processed in 53us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890928.700156:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788890928.700192:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788890928.700199:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996240000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890928.700232:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996240000:12345-0@lo:400:kworker.0 Request processed in 34us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890928.700238:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788890928.700264:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996239744:0@lo:400:kworker.0 00000100:00100000:1.0:1788890928.700284:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996240000:0@lo:400:kworker.0 00000100:00080000:2.0:1788890928.700483:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788890928.700488:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788890929.210666:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788890929.210688:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996240256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890929.210755:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890929.210813:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996240256 00000100:00100000:3.0:1788890929.210821:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996240256 00000100:00100000:3.0:1788890929.210863:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788890929.210872:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996240256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890929.210905:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890929.210946:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996240256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890929.210953:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788890929.210991:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1d0754000 x1875787996240256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890929.211008:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996240256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788890929.270560:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890930.294419:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890931.318414:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890931.945644:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890931.945833:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821312 00000100:00100000:1.0:1788890931.945843:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821312 00000100:00100000:1.0:1788890931.945896:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 196 00000100:00100000:1.0:1788890931.945905:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987821312:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890931.945973:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987821312:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 70us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890931.945979:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 196 00000100:00100000:0.0:1788890931.946776:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890931.946850:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821440 00000100:00100000:1.0:1788890931.946856:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821440 00000100:00080000:3.0:1788890931.946910:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890931.946916:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:1.0:1788890931.946927:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987821440:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890931.946971:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987821440:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 47us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890931.946977:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:2.0:1788890932.278836:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996240384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788890932.278911:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890932.279495:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996240384 00000100:00100000:3.0:1788890932.279509:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996240384 00000100:00100000:3.0:1788890932.279628:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788890932.279640:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996240384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890932.279677:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890932.279729:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996240384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890932.279735:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788890932.279858:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788890932.279890:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcb100 x1875787996240384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890932.279908:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996240384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788890932.342438:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890933.366581:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890933.815488:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996240640:0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.815568:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890933.815633:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996241152:0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.815672:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890933.815701:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788890933.815707:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996240512:0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.815733:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890933.815753:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996241024:0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.815774:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890933.815802:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996240768:0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.815825:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890933.815840:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890933.815845:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996240896:0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.815865:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890933.815891:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996240640 00000100:00100000:1.0:1788890933.815898:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996240640 00000100:00100000:1.0:1788890933.815938:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996241024 00000100:00100000:1.0:1788890933.815942:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996241024 00000100:00100000:1.0:1788890933.815963:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996240768 00000100:00100000:1.0:1788890933.815966:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996240768 00000100:00100000:1.0:1788890933.815984:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788890933.815991:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996240640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.816040:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996240640:12345-0@lo:400:kworker.0 Request processed in 50us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890933.816047:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788890933.816062:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788890933.816068:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996241024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.816106:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996241024:12345-0@lo:400:kworker.0 Request processed in 39us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890933.816112:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788890933.816125:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788890933.816131:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996240768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.816160:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996240768:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890933.816189:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788890933.816208:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996240512 00000100:00100000:1.0:1788890933.816212:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996240512 00000100:00100000:1.0:1788890933.816234:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788890933.816240:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996240512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.816268:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996240512:12345-0@lo:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890933.816395:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996241152 00000100:00100000:0.0:1788890933.816400:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996241152 00000100:00100000:0.0:1788890933.816427:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996240896 00000100:00100000:0.0:1788890933.816436:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996240896 00000100:00100000:0.0:1788890933.816450:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788890933.816455:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996241152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890933.816487:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996241152:12345-0@lo:400:kworker.0 Request processed in 32us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890933.816493:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788890933.816504:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788890933.816510:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996240896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890933.816532:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996240896:12345-0@lo:400:kworker.0 Request processed in 23us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890933.816537:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788890933.816689:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890933.816694:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890933.816813:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788890933.816871:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996240512:0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.816886:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996241024:0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.816896:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996240640:0@lo:400:kworker.0 00010000:00080000:1.0:1788890933.816906:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcb100 x1875787996241152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890933.816918:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996241152:0@lo:400:kworker.0 00010000:00080000:1.0:1788890933.816950:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcaa00 x1875787996240896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890933.816971:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996240896:0@lo:400:kworker.0 00000100:00100000:1.0:1788890933.816983:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996240768:0@lo:400:kworker.0 00000100:00100000:2.0:1788890934.326463:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890934.328100:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996241280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788890934.328188:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890934.328434:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996241280 00000100:00100000:3.0:1788890934.328442:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996241280 00000100:00100000:3.0:1788890934.328536:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788890934.328546:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996241280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890934.328582:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890934.328639:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996241280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890934.328647:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788890934.328716:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1d0754000 x1875787996241280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890934.328735:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996241280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788890934.390877:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890935.160489:0:10096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:08:54 (1788890934) === 00010000:00010000:2.0:1788890935.419286:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890935.442006:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890935.442088:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821568 00000100:00100000:3.0:1788890935.442098:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821568 00000100:00100000:3.0:1788890935.442153:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 198 00000100:00100000:3.0:1788890935.442162:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+10:8151:x1875787987821568:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788890935.442215:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890935.442233:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1f4edc800/0x9161b78f8ec3eec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1be3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890935.442259:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1f4edc800/0x9161b78f8ec3eec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1be3 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890935.442287:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1f4edc800/0x9161b78f8ec3eec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1be3 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890935.442296:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc800, rc 0) 00000100:00100000:3.0:1788890935.442357:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+11:8151:x1875787987821568:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 196us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890935.442363:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 198 00000100:00100000:2.0:1788890935.446232:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.446342:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821696 00000100:00100000:1.0:1788890935.446351:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821696 00000100:00100000:1.0:1788890935.446403:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 199 00000100:00100000:1.0:1788890935.446412:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+11:8151:x1875787987821696:12345-192.168.204.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788890935.446700:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+11:8151:x1875787987821696:12345-192.168.204.18@tcp:501:mount.lustre.0 Request processed in 287us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890935.446709:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 199 00000100:00100000:0.0:1788890935.453833:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.454033:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821824 00000100:00100000:1.0:1788890935.454044:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821824 00000100:00100000:1.0:1788890935.454105:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 200 00000100:00100000:1.0:1788890935.454117:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+11:8151:x1875787987821824:12345-192.168.204.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788890935.454392:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+11:8151:x1875787987821824:12345-192.168.204.18@tcp:503:mount.lustre.0 Request processed in 276us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890935.454400:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 200 00000100:00100000:0.0:1788890935.458941:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.459049:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987821952 00000100:00100000:1.0:1788890935.459060:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987821952 00000100:00100000:1.0:1788890935.459118:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 201 00000100:00100000:1.0:1788890935.459128:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+11:8155:x1875787987821952:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788890935.459535:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+11:8155:x1875787987821952:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 407us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890935.459544:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 201 00000100:00100000:2.0:1788890935.473481:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.473560:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822080 00000100:00100000:1.0:1788890935.473570:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822080 00000100:00100000:1.0:1788890935.473658:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 202 00000100:00100000:1.0:1788890935.473668:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+11:8155:x1875787987822080:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788890935.473968:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+11:8155:x1875787987822080:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 300us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890935.473977:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 202 00000100:00100000:0.0:1788890935.480486:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.480710:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822208 00000100:00100000:1.0:1788890935.480720:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822208 00000100:00100000:1.0:1788890935.480768:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 203 00000100:00100000:1.0:1788890935.480779:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+11:8151:x1875787987822208:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788890935.480796:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890935.480814:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6e800/0x9161b78f8ec3eecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890935.480845:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6e800/0x9161b78f8ec3eecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c0d expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890935.480856:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6e800/0x9161b78f8ec3eecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c0d expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890935.480865:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e800, rc 0) 00000100:00100000:1.0:1788890935.480978:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+12:8151:x1875787987822208:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 200us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890935.480986:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 203 00000100:00100000:0.0:1788890935.489468:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.489851:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822336 00000100:00100000:1.0:1788890935.489863:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822336 00000100:00100000:1.0:1788890935.489940:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 204 00000100:00100000:1.0:1788890935.489951:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+12:8151:x1875787987822336:12345-192.168.204.18@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788890935.489988:0:5808:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788890935.490006:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788890935.490010:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788890935.490013:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788890935.490015:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788890935.496742:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+12:8151:x1875787987822336:12345-192.168.204.18@tcp:256:mount.lustre.0 Request processed in 6777us (7269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890935.496758:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 204 00000100:00100000:0.0:1788890935.500561:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890935.500655:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822464 00000100:00100000:3.0:1788890935.500665:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822464 00000100:00100000:3.0:1788890935.500779:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 205 00000100:00100000:3.0:1788890935.500790:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+12:8151:x1875787987822464:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788890935.500808:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890935.500828:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c14 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890935.500858:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c14 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890935.500870:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c14 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890935.500881:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edde00, rc 0) 00000100:00100000:3.0:1788890935.500952:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:8151:x1875787987822464:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 163us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890935.500960:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 205 00000100:00100000:0.0:1788890935.503946:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.506636:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822592 00000100:00100000:1.0:1788890935.506661:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822592 00000100:00100000:1.0:1788890935.506804:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 206 00000100:00100000:1.0:1788890935.506816:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:8151:x1875787987822592:12345-192.168.204.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788890935.507303:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:8151:x1875787987822592:12345-192.168.204.18@tcp:501:mount.lustre.0 Request processed in 488us (3364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890935.507353:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 206 00000100:00100000:1.0:1788890935.511450:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890935.511616:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822720 00000100:00100000:3.0:1788890935.511638:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822720 00000100:00100000:2.0:1788890935.511788:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 207 00000100:00100000:2.0:1788890935.511801:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:8151:x1875787987822720:12345-192.168.204.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788890935.512081:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:8151:x1875787987822720:12345-192.168.204.18@tcp:503:mount.lustre.0 Request processed in 282us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890935.512089:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 207 00000100:00100000:0.0:1788890935.516297:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.516443:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822848 00000100:00100000:1.0:1788890935.516453:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822848 00000100:00100000:1.0:1788890935.516573:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 208 00000100:00100000:1.0:1788890935.516583:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:8160:x1875787987822848:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788890935.516845:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:8160:x1875787987822848:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 262us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890935.516853:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 208 00000100:00100000:0.0:1788890935.521626:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890935.522116:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987822976 00000100:00100000:3.0:1788890935.522127:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987822976 00000100:00100000:3.0:1788890935.522281:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 209 00000100:00100000:3.0:1788890935.522295:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:8160:x1875787987822976:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788890935.522564:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:8160:x1875787987822976:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 272us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890935.522573:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 209 00000100:00100000:3.0:1788890935.527620:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890935.527663:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890935.528334:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823488 00000100:00100000:0.0:1788890935.528345:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823488 00000100:00100000:0.0:1788890935.528493:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823104 00000100:00100000:0.0:1788890935.528507:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823104 00000100:00100000:0.0:1788890935.528533:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:0.0:1788890935.528545:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987823488:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890935.528636:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987823488:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 93us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890935.528658:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:0.0:1788890935.528677:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:0.0:1788890935.528682:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2371:x1875787987823104:12345-192.168.204.18@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788890935.528706:0:5815:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 852e3539-1359-4cf9-b701-3f696e6c6e5e@192.168.204.18@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:0.0:1788890935.528741:0:5815:0:(genops.c:1385:class_connect()) connect: client 852e3539-1359-4cf9-b701-3f696e6c6e5e, cookie 0x9161b78f8ec3eeda 00000004:00100000:0.0:1788890935.528772:0:5815:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788890935.528963:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788890935.529052:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9da0c1184000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788890935.529087:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:2371:x1875787987823104:12345-192.168.204.18@tcp:38:mount.lustre.0 Request processed in 403us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890935.529096:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:0.0:1788890935.531623:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890935.531776:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823360 00000100:00100000:2.0:1788890935.531837:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823360 00000100:00100000:2.0:1788890935.531958:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:2.0:1788890935.531968:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:8151:x1875787987823360:12345-192.168.204.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788890935.532008:0:6852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788890935.532094:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:8151:x1875787987823360:12345-192.168.204.18@tcp:41:mount.lustre.0 Request processed in 128us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890935.532103:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:2.0:1788890935.533460:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890935.533538:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823232 00000100:00100000:3.0:1788890935.533545:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823232 00000100:00100000:3.0:1788890935.533595:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:3.0:1788890935.533605:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:0:x1875787987823232:12345-192.168.204.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788890935.533628:0:5814:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788890935.533702:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:0:x1875787987823232:12345-192.168.204.18@tcp:41:mount.lustre.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890935.533710:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00080000:0.0:1788890935.533772:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890935.534497:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890935.534603:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823616 00000100:00100000:2.0:1788890935.534609:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823616 00000100:00100000:2.0:1788890935.534650:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:2.0:1788890935.534660:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:8151:x1875787987823616:12345-192.168.204.18@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788890935.534726:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:8151:x1875787987823616:12345-192.168.204.18@tcp:40:mount.lustre.0 Request processed in 67us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890935.534733:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:2.0:1788890935.538265:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890935.538301:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.538338:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824000 00000100:00100000:1.0:1788890935.538362:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824000 00000100:00100000:0.0:1788890935.538363:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823744 00000100:00100000:0.0:1788890935.538369:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823744 00000100:00100000:2.0:1788890935.538386:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890935.538431:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:1.0:1788890935.538444:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:8151:x1875787987824000:12345-192.168.204.18@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788890935.538514:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987823872 00000100:00100000:0.0:1788890935.538519:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987823872 00000100:00100000:0.0:1788890935.538537:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 12 00000004:00200000:1.0:1788890935.538542:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788890935.538543:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875787987823744:12345-192.168.204.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788890935.538572:0:6664:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 852e3539-1359-4cf9-b701-3f696e6c6e5e@192.168.204.18@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:0.0:1788890935.538603:0:6664:0:(genops.c:1385:class_connect()) connect: client 852e3539-1359-4cf9-b701-3f696e6c6e5e, cookie 0x9161b78f8ec3eee1 00002000:00100000:0.0:1788890935.538616:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 852e3539-1359-4cf9-b701-3f696e6c6e5e/ffff9da0c1182800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788890935.538641:0:6664:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788890935.538648:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:8151:x1875787987824000:12345-192.168.204.18@tcp:33:mount.lustre.0 Request processed in 197us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890935.538659:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 1 00002000:00080000:0.0:1788890935.538897:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788890935.538925:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9da0c1182000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788890935.538965:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:2371:x1875787987823744:12345-192.168.204.18@tcp:8:mount.lustre.0 Request processed in 421us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890935.538972:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:0.0:1788890935.538987:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:0.0:1788890935.538992:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875787987823872:12345-192.168.204.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788890935.539008:0:6664:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 852e3539-1359-4cf9-b701-3f696e6c6e5e@192.168.204.18@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:0.0:1788890935.539023:0:6664:0:(genops.c:1385:class_connect()) connect: client 852e3539-1359-4cf9-b701-3f696e6c6e5e, cookie 0x9161b78f8ec3eee8 00002000:00100000:0.0:1788890935.539028:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 852e3539-1359-4cf9-b701-3f696e6c6e5e/ffff9da0c1180000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788890935.539034:0:6664:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788890935.539156:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788890935.539194:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9da0c1180800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788890935.539216:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:2371:x1875787987823872:12345-192.168.204.18@tcp:8:mount.lustre.0 Request processed in 223us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890935.539222:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 13 00000001:00100000:3.0:1788890935.902111:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 852e3539-1359-4cf9-b701-3f696e6c6e5e 00000001:00100000:0.0:1788890936.402309:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 852e3539-1359-4cf9-b701-3f696e6c6e5e 00010000:00010000:3.0:1788890936.440696:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890937.398553:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890937.398579:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996241408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890937.398655:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890937.398757:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996241408 00000100:00100000:3.0:1788890937.398766:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996241408 00000100:00100000:3.0:1788890937.398850:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788890937.398923:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890937.398959:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996241408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890937.399000:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890937.399059:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996241408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890937.399080:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788890937.399159:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1d0756a00 x1875787996241408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890937.399214:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996241408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788890937.463088:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890938.488352:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890938.935457:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996241664:0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.935662:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890938.935728:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996242176:0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.935756:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890938.935788:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788890938.935795:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996241536:0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.935823:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890938.935842:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996242048:0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.935864:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890938.935893:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996241792:0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.935915:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890938.935931:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890938.935936:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996241920:0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.935959:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890938.935965:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996241664 00000100:00100000:2.0:1788890938.935974:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996241664 00000100:00100000:0.0:1788890938.935990:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996242048 00000100:00100000:0.0:1788890938.935996:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996242048 00000100:00100000:2.0:1788890938.936024:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996241792 00000100:00100000:2.0:1788890938.936028:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996241792 00000100:00100000:0.0:1788890938.936035:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788890938.936047:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996241664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890938.936052:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788890938.936062:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996242048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.936109:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996241664:12345-0@lo:400:kworker.0 Request processed in 64us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890938.936117:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996242048:12345-0@lo:400:kworker.0 Request processed in 55us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890938.936120:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788890938.936133:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788890938.936140:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788890938.936150:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996241792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.936242:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996241792:12345-0@lo:400:kworker.0 Request processed in 95us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890938.936249:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788890938.936279:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996242176 00000100:00100000:0.0:1788890938.936283:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996242176 00000100:00100000:0.0:1788890938.936314:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996241920 00000100:00100000:0.0:1788890938.936317:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996241920 00000100:00100000:0.0:1788890938.936331:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788890938.936336:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996242176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.936366:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996242176:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890938.936372:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788890938.936382:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788890938.936387:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996241920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.936411:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996241920:12345-0@lo:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890938.936416:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788890938.936434:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996241536 00000100:00100000:0.0:1788890938.936438:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996241536 00000100:00100000:0.0:1788890938.936458:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788890938.936464:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996241536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.936695:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996241536:12345-0@lo:400:kworker.0 Request processed in 230us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890938.936702:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:0.0:1788890938.936735:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788890938.936740:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890938.936762:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996241536:0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.936841:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996242048:0@lo:400:kworker.0 00000100:00100000:0.0:1788890938.936853:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996241664:0@lo:400:kworker.0 00010000:00080000:0.0:1788890938.936865:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1fbb28e00 x1875787996242176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890938.936888:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996242176:0@lo:400:kworker.0 00010000:00080000:2.0:1788890938.937581:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da2018ff480 x1875787996241920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890938.937594:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996241920:0@lo:400:kworker.0 00000100:00100000:2.0:1788890938.937607:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996241792:0@lo:400:kworker.0 00000001:02000400:0.0:1788890939.050998:0:10294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788890939.446358:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890939.446382:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996242304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788890939.446456:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890939.446529:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996242304 00000100:00100000:2.0:1788890939.446537:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996242304 00000100:00100000:2.0:1788890939.446589:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788890939.446599:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996242304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788890939.446635:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788890939.446681:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996242304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890939.446689:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788890939.446741:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c592ad80 x1875787996242304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890939.446762:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996242304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788890939.511373:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788890940.504073:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 852e3539-1359-4cf9-b701-3f696e6c6e5e 00010000:00010000:0.0:1788890940.535294:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890940.651086:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890940.651127:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890940.651157:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890940.651165:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824128 00000100:00100000:3.0:1788890940.651204:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824128 00000100:00100000:0.0:1788890940.651213:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890940.651229:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824384 00000100:00100000:1.0:1788890940.651235:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824640 00000100:00100000:2.0:1788890940.651236:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824384 00000100:00100000:1.0:1788890940.651243:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824640 00000100:00100000:3.0:1788890940.651273:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 211 00000100:00100000:3.0:1788890940.651288:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987824128:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890940.651297:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:1.0:1788890940.651309:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2374:x1875787987824640:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890940.651317:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890940.651366:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987824128:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 79us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890940.651367:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2374:x1875787987824640:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 60us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890940.651371:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824256 00000100:00100000:2.0:1788890940.651378:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824256 00000100:00100000:3.0:1788890940.651386:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 211 00000100:00100000:1.0:1788890940.651386:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:1.0:1788890940.651410:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824512 00000100:00100000:1.0:1788890940.651414:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824512 00000100:00100000:1.0:1788890940.651442:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00100000:1.0:1788890940.651449:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2374:x1875787987824512:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890940.651473:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2374:x1875787987824512:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 25us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890940.651480:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00080000:1.0:1788890940.651495:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788890940.651500:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788890940.651502:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788890940.652089:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 55 00000100:00100000:0.0:1788890940.652103:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2374:x1875787987824384:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890940.652135:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2374:x1875787987824384:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 37us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890940.652142:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 56 00000100:00100000:2.0:1788890940.652192:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987824256:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890940.652236:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987824256:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 72us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890940.652242:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 55 00000100:00100000:2.0:1788890940.652315:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 56 00010000:00010000:2.0:1788890941.559318:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890942.518310:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890942.518335:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996242432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890942.518404:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890942.518953:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996242432 00000100:00100000:2.0:1788890942.518962:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996242432 00000100:00100000:2.0:1788890942.519031:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788890942.519042:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996242432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788890942.519079:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788890942.519155:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996242432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890942.519162:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788890942.519279:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788890942.519310:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1fbb2ad80 x1875787996242432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890942.519332:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996242432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788890942.582580:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890943.607922:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890944.055037:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996242560:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.055108:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890944.055370:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996243072:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.055399:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890944.055428:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788890944.055434:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996242688:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.056557:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890944.056584:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996243200:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.056614:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890944.056650:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996242816:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.056676:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890944.056698:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788890944.056704:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996242944:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.056727:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890944.056760:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996242560 00000100:00100000:1.0:1788890944.056766:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996242560 00000100:00100000:1.0:1788890944.056813:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788890944.056823:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996242560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.056874:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996242560:12345-0@lo:400:kworker.0 Request processed in 53us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890944.056881:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788890944.056922:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996243072 00000100:00100000:1.0:1788890944.056926:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996243072 00000100:00100000:1.0:1788890944.056957:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996242688 00000100:00100000:1.0:1788890944.056959:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996242688 00000100:00100000:1.0:1788890944.056970:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996242816 00000100:00100000:1.0:1788890944.056972:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996242816 00000100:00100000:1.0:1788890944.056984:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788890944.056990:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996243072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.057033:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996243072:12345-0@lo:400:kworker.0 Request processed in 43us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890944.057039:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788890944.057052:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788890944.057058:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996242688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.057083:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996242688:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890944.057089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788890944.057101:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788890944.057107:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996242816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.057138:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996242816:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890944.057144:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788890944.057198:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996243200 00000100:00100000:1.0:1788890944.057202:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996243200 00000100:00100000:1.0:1788890944.057229:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996242944 00000100:00100000:1.0:1788890944.057232:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996242944 00000100:00100000:1.0:1788890944.057249:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788890944.057256:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996243200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.057289:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996243200:12345-0@lo:400:kworker.0 Request processed in 34us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890944.057295:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788890944.057306:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788890944.057313:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996242944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.057338:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996242944:12345-0@lo:400:kworker.0 Request processed in 27us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890944.057354:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788890944.057387:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788890944.057392:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788890944.057395:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788890944.057423:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcbb80 x1875787996242944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890944.057437:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996242944:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.057463:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996242816:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.057505:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996242688:0@lo:400:kworker.0 00010000:00080000:1.0:1788890944.057515:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bcb100 x1875787996243200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890944.057524:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996243200:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.057533:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996242560:0@lo:400:kworker.0 00000100:00100000:1.0:1788890944.057543:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996243072:0@lo:400:kworker.0 00000100:00100000:3.0:1788890944.567704:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788890944.567731:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996243328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890944.567804:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890944.567938:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996243328 00000100:00100000:2.0:1788890944.567946:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996243328 00000100:00100000:2.0:1788890944.568000:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788890944.568011:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996243328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788890944.568046:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788890944.568199:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996243328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890944.568207:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788890944.570408:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1d0755c00 x1875787996243328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890944.570436:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996243328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890944.631437:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890945.654421:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890945.770683:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890945.770728:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890945.770759:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890945.770780:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890945.770805:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890945.770830:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825152 00000100:00100000:3.0:1788890945.770839:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825152 00000100:00100000:1.0:1788890945.770857:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824896 00000100:00100000:1.0:1788890945.770863:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824896 00000100:00100000:1.0:1788890945.770907:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825024 00000100:00100000:3.0:1788890945.770909:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825280 00000100:00100000:1.0:1788890945.770911:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825024 00000100:00100000:3.0:1788890945.770915:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825280 00000100:00100000:3.0:1788890945.770943:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:1.0:1788890945.770949:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:3.0:1788890945.770958:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825152:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890945.770962:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987824896:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788890945.771035:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825152:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890945.771056:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:3.0:1788890945.771072:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 38 00000100:00100000:3.0:1788890945.771078:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825280:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890945.771149:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987824896:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 191us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890945.771157:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:1.0:1788890945.771199:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:1.0:1788890945.771206:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825024:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890945.771237:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825024:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890945.771243:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:3.0:1788890945.771820:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825280:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 739us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890945.771828:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 38 00000100:00100000:3.0:1788890945.771852:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987824768 00000100:00100000:3.0:1788890945.771856:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987824768 00000100:00100000:3.0:1788890945.771944:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 213 00000100:00100000:3.0:1788890945.771952:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2372:x1875787987824768:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788890945.771982:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2372:x1875787987824768:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 32us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890945.771989:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 213 00000100:00080000:3.0:1788890945.772067:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890945.772072:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788890945.772074:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788890946.682041:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890947.638759:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996243456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890947.638843:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890947.638909:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996243456 00000100:00100000:2.0:1788890947.638917:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996243456 00000100:00080000:3.0:1788890947.638950:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890947.638981:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788890947.638991:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996243456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788890947.639025:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788890947.639108:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996243456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890947.639117:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788890947.639157:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1fbb2ad80 x1875787996243456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890947.639214:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996243456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788890947.703356:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890948.727328:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890948.798568:0:10996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788890949.174360:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996243584:0@lo:400:kworker.0 00000100:00100000:1.0:1788890949.174374:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996243712:0@lo:400:kworker.0 00000100:00100000:2.0:1788890949.174492:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996243840:0@lo:400:kworker.0 00000100:00100000:1.0:1788890949.174689:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890949.174700:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996243968:0@lo:400:kworker.0 00000100:00100000:2.0:1788890949.174734:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890949.174746:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996244224:0@lo:400:kworker.0 00000100:00100000:1.0:1788890949.174778:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890949.174794:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996243968 00000100:00100000:2.0:1788890949.174802:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996243968 00000100:00100000:2.0:1788890949.174852:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996244224 00000100:00100000:2.0:1788890949.174856:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996244224 00000100:00100000:2.0:1788890949.174887:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788890949.174899:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996243968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890949.174949:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890949.174957:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996244096:0@lo:400:kworker.0 00000100:00100000:2.0:1788890949.174965:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996243968:12345-0@lo:400:kworker.0 Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890949.174974:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788890949.174993:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788890949.174994:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890949.174999:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996244224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890949.175026:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996243712 00000100:00100000:1.0:1788890949.175030:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996243712 00000100:00100000:2.0:1788890949.175047:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996244224:12345-0@lo:400:kworker.0 Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890949.175066:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996244096 00000100:00100000:1.0:1788890949.175069:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996244096 00000100:00100000:1.0:1788890949.175155:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788890949.175161:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788890949.175201:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996243712:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788890949.175218:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788890949.175231:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788890949.175232:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996243712:12345-0@lo:400:kworker.0 Request processed in 33us (544us total) trans 0 rc 0/0 00000100:00080000:2.0:1788890949.175234:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890949.175237:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788890949.175249:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788890949.175254:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996244096:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788890949.175261:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da0c1ab3800 x1875787996243968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890949.175274:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996243968:0@lo:400:kworker.0 00000100:00100000:1.0:1788890949.175276:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996244096:12345-0@lo:400:kworker.0 Request processed in 23us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890949.175281:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788890949.175305:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890949.175318:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996243840 00000100:00100000:1.0:1788890949.175321:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996243840 00000100:00100000:2.0:1788890949.175339:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996244096:0@lo:400:kworker.0 00000100:00100000:1.0:1788890949.175345:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788890949.175348:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996243712:0@lo:400:kworker.0 00000100:00100000:1.0:1788890949.175351:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996243840:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788890949.175357:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da0c1ab1880 x1875787996244224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890949.175365:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996244224:0@lo:400:kworker.0 00000100:00080000:2.0:1788890949.175380:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890949.175381:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996243840:12345-0@lo:400:kworker.0 Request processed in 30us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890949.175387:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788890949.175391:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996243840:0@lo:400:kworker.0 00000100:00100000:0.0:1788890949.175522:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890949.175748:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996243584 00000100:00100000:1.0:1788890949.175753:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996243584 00000100:00100000:1.0:1788890949.175819:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788890949.175826:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996243584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890949.175878:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3281:x1875787996243584:12345-0@lo:400:kworker.0 Request processed in 52us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890949.175884:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788890949.176108:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996243584:0@lo:400:kworker.0 00000100:00100000:0.0:1788890949.687303:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996244352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890949.687368:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890949.687462:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996244352 00000100:00100000:2.0:1788890949.687470:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996244352 00000100:00100000:0.0:1788890949.687733:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788890949.687747:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996244352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788890949.687782:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788890949.687835:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996244352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890949.687842:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788890949.687884:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c5929c00 x1875787996244352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890949.687902:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996244352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890949.750475:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788890950.655450:0:11143:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd57d8410 20000000:00000080:0.0:1788890950.655466:0:11143:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9da1c56c9800 uarg=0000000000000000 20000000:01000000:0.0:1788890950.655500:0:11143:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788890950.655506:0:11143:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788890950.655511:0:11143:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788890950.656081:0:11144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788890950.656372:0:11143:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788890950.661821:0:11143:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788890950.661852:0:11143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.661874:0:11143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bdc expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.661894:0:11143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ee9b expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.661901:0:11143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eea9 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.661909:0:11143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eeb7 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.661916:0:11143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c14 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.661924:0:11143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.661967:0:11143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c14 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.661982:0:11143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c14 expref: 12 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.661999:0:11143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996244480:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890950.662119:0:11143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3eeb7 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662127:0:11143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3eeb7 expref: 18 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.662137:0:11143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996244608:0@lo:104: 00000100:00100000:0.0:1788890950.662336:0:11143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890950.662383:0:11143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3eea9 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662398:0:11143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3eea9 expref: 18 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.662407:0:11143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996244736:0@lo:104: 00000100:00100000:0.0:1788890950.662429:0:11143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890950.662455:0:11143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ee9b expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662463:0:11143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ee9b expref: 18 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.662472:0:11143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996244864:0@lo:104: 00000100:00100000:0.0:1788890950.662492:0:11143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890950.662519:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996244608 00000100:00100000:0.0:1788890950.662526:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996244608 00000100:00100000:0.0:1788890950.662568:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996244736 00000100:00100000:0.0:1788890950.662572:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996244736 00000100:00100000:0.0:1788890950.662582:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996244864 00000100:00100000:0.0:1788890950.662585:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996244864 00000100:00100000:0.0:1788890950.662598:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788890950.662608:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+5:11143:x1875787996244608:12345-0@lo:104: 00000100:00100000:2.0:1788890950.662617:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788890950.662620:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890950.662630:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+5:11143:x1875787996244736:12345-0@lo:104: 00010000:00010000:2.0:1788890950.662648:0:5797:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662671:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788890950.662678:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+5:11143:x1875787996244608:12345-0@lo:104: Request processed in 72us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890950.662692:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788890950.662710:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788890950.662716:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788890950.662721:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+4:11143:x1875787996244736:12345-0@lo:104: Request processed in 95us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890950.662728:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+4:11143:x1875787996244864:12345-0@lo:104: 00000100:00100000:2.0:1788890950.662733:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788890950.662742:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.662758:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788890950.662770:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.662777:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030000 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788890950.662781:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662784:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788890950.662794:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.662795:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+3:11143:x1875787996244864:12345-0@lo:104: Request processed in 69us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890950.662807:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:00010000:2.0:1788890950.662814:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890950.662820:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788890950.662825:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788890950.662832:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662839:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e200 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788890950.662843:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.662848:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662852:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.662859:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1788890950.662867:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788890950.662874:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788890950.662881:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.662888:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c0030000/0x9161b78f8ec3eeb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eebe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662895:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.662899:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890950.662906:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662906:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890950.662913:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fa00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788890950.662917:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.662936:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662936:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890950.662952:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662956:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e200/0x9161b78f8ec3eea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eeb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890950.662960:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788890950.662974:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890950.662977:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.662977:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890950.662979:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890950.662986:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788890950.662988:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890950.662993:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.663000:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6fa00/0x9161b78f8ec3ee9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eea2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.663008:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996245120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788890950.663012:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890950.663015:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890950.663017:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890950.663041:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996244992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788890950.663049:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890950.663078:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890950.663085:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996245248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788890950.663092:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890950.663117:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890950.663134:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996245120 00000100:00100000:2.0:1788890950.663138:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996245120 00010000:00010000:2.0:1788890950.663156:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eea9 expref: 19 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890950.663193:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996244992 00000100:00100000:2.0:1788890950.663197:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996244992 00010000:00010000:2.0:1788890950.663218:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eeb7 expref: 20 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890950.663230:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996245248 00000100:00100000:2.0:1788890950.663233:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996245248 00010000:00010000:2.0:1788890950.663244:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ee9b expref: 21 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890950.663256:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788890950.663258:0:11143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bdc expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890950.663264:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+21:3281:x1875787996245120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788890950.663279:0:11143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bdc expref: 12 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.663280:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890950.663288:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eea9 expref: 21 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.663296:0:11143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f22a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996245376:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890950.663299:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3eea9 expref: 21 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.663315:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890950.663349:0:11143:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cafb6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788890950.663352:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+21:3281:x1875787996245120:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890950.663360:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788890950.663372:0:11143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996244608:0@lo:104: 00000100:00100000:2.0:1788890950.663376:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890950.663386:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+20:3280:x1875787996244992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788890950.663391:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3eeb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3eea9 expref: 20 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.663395:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890950.663402:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eeb7 expref: 20 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.663407:0:11143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996244736:0@lo:104: 00010000:00010000:2.0:1788890950.663414:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3eeb7 expref: 19 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.663421:0:11143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996244864:0@lo:104: 00010000:00010000:2.0:1788890950.663435:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3eebe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3eeb7 expref: 19 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.663444:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890950.663482:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+18:3280:x1875787996244992:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890950.663488:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788890950.663527:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996244992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788890950.663531:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788890950.663539:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+17:3281:x1875787996245248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788890950.663545:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890950.663549:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ee9b expref: 17 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.663556:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ee9b expref: 17 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.663565:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3eea2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ee9b expref: 17 pid: 5810 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.663572:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890950.663594:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+16:3281:x1875787996245248:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890950.663599:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788890950.663624:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996245248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788890950.663633:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996245120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788890950.664725:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890950.664789:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825408 00000100:00100000:1.0:1788890950.664796:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825408 00010000:00010000:1.0:1788890950.664819:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c14 expref: 13 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890950.664849:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:1.0:1788890950.664859:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47df6031-18d1-4179-91e9-917028d5aced+13:2375:x1875787987825408:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890950.664869:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890950.664875:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c14 expref: 13 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890950.664885:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c14 expref: 13 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890950.664911:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890950.664949:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47df6031-18d1-4179-91e9-917028d5aced+13:2375:x1875787987825408:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890950.664956:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 27 00010000:00010000:0.0:1788890950.665230:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1f4edde00/0x9161b78f8ec3eed3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c14 expref: 12 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.665243:0:11143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996244480:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890950.666365:0:11143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f22a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11143:1875787996245376:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890950.666398:0:11143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890950.669095:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890950.669202:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825536 00000100:00100000:0.0:1788890950.669211:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825536 00010000:00010000:0.0:1788890950.669245:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bdc expref: 12 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890950.669293:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 28 00000100:00100000:0.0:1788890950.669306:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+12:2375:x1875787987825536:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890950.669324:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890950.669330:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bdc expref: 12 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669343:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bdc expref: 12 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669360:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c9c86200/0x9161b78f8ec3ee94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bdc expref: 12 pid: 5807 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669374:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669392:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669409:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669417:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669423:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669430:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669436:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788890950.669440:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669448:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669473:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890950.669483:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890950.669543:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+11:2375:x1875787987825536:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 239us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890950.669551:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 28 00010000:00010000:3.0:1788890950.669574:0:11143:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890950.669582:0:11143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890950.669587:0:11143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3eeef lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890950.776691:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890950.892154:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890950.892230:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890950.892261:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890950.892303:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890950.892328:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825664 00000100:00100000:0.0:1788890950.892354:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825664 00000100:00100000:2.0:1788890950.892395:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825920 00000100:00100000:2.0:1788890950.892401:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825920 00000100:00100000:0.0:1788890950.892487:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987825792 00000100:00100000:0.0:1788890950.892491:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987825792 00000100:00100000:1.0:1788890950.892552:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 65 00000100:00100000:1.0:1788890950.892564:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987825664:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890950.892656:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2372:x1875787987825664:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 90us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890950.892664:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 65 00000100:00100000:1.0:1788890950.892735:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826048 00000100:00100000:1.0:1788890950.892743:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826048 00000100:00100000:2.0:1788890950.894147:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00100000:2.0:1788890950.894158:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825920:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890950.894218:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825920:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 63us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890950.894224:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00080000:3.0:1788890950.894820:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890950.894826:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788890950.894829:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890950.894962:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 66 00000100:00100000:1.0:1788890950.894969:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 42 00000100:00100000:0.0:1788890950.894983:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825792:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890950.894984:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987826048:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890950.895044:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987825792:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 72us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890950.895045:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987826048:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 65us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890950.895058:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 66 00000100:00100000:1.0:1788890950.895062:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 42 10000000:01000000:2.0:1788890951.673117:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788890951.673125:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1c5240800 from 7 10000000:01000000:2.0:1788890951.673131:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788890951.673195:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.673207:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.673219:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890951.673246:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996245504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.673315:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890951.673382:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab86900 going to sleep for 11 seconds 00000100:00100000:3.0:1788890951.675261:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996245504 00000100:00100000:3.0:1788890951.675273:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996245504 00000100:00100000:3.0:1788890951.675335:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788890951.675346:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996245504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890951.675361:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890951.675377:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3eef6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890951.675401:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3eef6 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890951.675411:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eef6 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890951.675420:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edcc00, rc 0) 00000100:00100000:3.0:1788890951.675545:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996245504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890951.675552:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788890951.675847:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996245504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890951.675864:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.675874:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890951.675946:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996245632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.675978:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890951.676015:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996245632 00000100:00100000:1.0:1788890951.676020:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996245632 00000100:00100000:2.0:1788890951.676031:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab86900 going to sleep for 11 seconds 00000100:00100000:1.0:1788890951.676056:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788890951.676063:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996245632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890951.676314:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996245632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890951.676321:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788890951.676592:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996245632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.676619:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996245760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.676679:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890951.676707:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab86900 going to sleep for 11 seconds 00000100:00100000:1.0:1788890951.677025:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996245760 00000100:00100000:1.0:1788890951.677035:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996245760 00000100:00100000:1.0:1788890951.677097:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788890951.677105:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996245760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890951.677279:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996245760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890951.677286:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788890951.677366:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996245760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788890951.677996:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788890951.678055:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788890951.678071:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788890951.678080:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.678091:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890951.678102:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788890951.678104:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1f4e26000 from 7 10000000:01000000:2.0:1788890951.678107:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788890951.678130:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.678138:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.678158:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890951.678194:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996245888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.678229:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890951.679289:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996245888 00000100:00100000:1.0:1788890951.679296:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996245888 00000100:00100000:1.0:1788890951.679399:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788890951.679409:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996245888:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.679410:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab860c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788890951.679425:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890951.679439:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ef04 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890951.679742:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ef04 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890951.679757:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ef04 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890951.679767:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e600, rc 0) 00000100:00100000:1.0:1788890951.679821:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996245888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 414us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890951.679828:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788890951.679893:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996245888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890951.679908:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.679918:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890951.679970:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.680013:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890951.680033:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab860c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890951.680133:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996246016 00000100:00100000:0.0:1788890951.680137:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996246016 00000100:00100000:0.0:1788890951.680191:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788890951.680200:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996246016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890951.680449:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996246016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890951.680457:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788890951.682091:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.682135:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.682218:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890951.682250:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890951.682271:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996246144 00000100:00100000:1.0:1788890951.682278:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996246144 00000100:00100000:1.0:1788890951.682329:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788890951.682338:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996246144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890951.682567:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996246144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890951.682575:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788890951.682594:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788890951.683743:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788890951.684437:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788890951.684462:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788890951.684472:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.684492:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890951.684503:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788890951.684505:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1c9db0800 from 7 10000000:01000000:2.0:1788890951.684508:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788890951.684538:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.684547:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.684557:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890951.684575:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.684611:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890951.684640:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab860c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890951.684683:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996246272 00000100:00100000:0.0:1788890951.684688:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996246272 00000100:00100000:0.0:1788890951.684725:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788890951.684732:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996246272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890951.684744:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890951.684757:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ef12 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890951.684779:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ef12 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890951.684790:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ef12 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890951.684806:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030000, rc 0) 00000100:00100000:0.0:1788890951.684868:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996246272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890951.684873:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788890951.685025:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890951.685037:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.685046:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890951.685088:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.685111:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890951.685151:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab860c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890951.685161:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996246400 00000100:00100000:0.0:1788890951.685197:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996246400 00000100:00100000:0.0:1788890951.685224:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788890951.685232:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996246400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890951.685447:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996246400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890951.685456:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788890951.685555:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.685580:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890951.685617:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890951.685644:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996246528 00000100:00100000:2.0:1788890951.685646:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890951.685650:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996246528 00000100:00100000:1.0:1788890951.685732:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788890951.685741:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996246528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890951.686049:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996246528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 309us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890951.686057:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788890951.686078:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996246528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788890951.687107:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788890951.687195:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788890951.687218:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788890951.687225:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890951.687235:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890951.800098:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890952.042383:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890952.042452:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826176 00000100:00100000:1.0:1788890952.042462:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826176 00000100:00100000:1.0:1788890952.042513:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 224 00000100:00100000:1.0:1788890952.042523:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+11:5603:x1875787987826176:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890952.042538:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890952.042555:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c3e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890952.042579:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c3e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890952.042589:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c3e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890952.042598:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6fe00, rc 0) 00000100:00100000:1.0:1788890952.042656:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987826176:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 Request processed in 134us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890952.042672:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 224 00000100:00100000:2.0:1788890952.046356:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890952.048189:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826304 00000100:00100000:1.0:1788890952.048199:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826304 00000100:00100000:1.0:1788890952.048252:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 225 00000100:00100000:1.0:1788890952.048263:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987826304:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890952.048531:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987826304:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 Request processed in 270us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890952.048539:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 225 00000100:00100000:3.0:1788890952.056133:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890952.056236:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826432 00000100:00100000:3.0:1788890952.056245:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826432 00000100:00100000:3.0:1788890952.056350:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 226 00000100:00100000:3.0:1788890952.056417:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987826432:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890952.056622:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987826432:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 Request processed in 262us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890952.056630:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 226 00000100:00100000:0.0:1788890952.060374:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890952.060576:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826560 00000100:00100000:3.0:1788890952.060586:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826560 00000100:00100000:3.0:1788890952.060644:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 227 00000100:00100000:3.0:1788890952.060655:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987826560:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890952.060671:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890952.060689:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c45 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890952.060715:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c45 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890952.060728:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c45 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890952.060738:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd600, rc 0) 00000100:00100000:3.0:1788890952.060806:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987826560:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 Request processed in 149us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890952.060822:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 227 00000100:00100000:2.0:1788890952.063029:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890952.063259:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826688 00000100:00100000:3.0:1788890952.063267:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826688 00000100:00100000:3.0:1788890952.063314:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 228 00000100:00100000:3.0:1788890952.063323:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987826688:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788890952.063711:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987826688:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 Request processed in 388us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890952.063719:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 228 00000100:00100000:0.0:1788890952.070566:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890952.072442:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826816 00000100:00100000:3.0:1788890952.072455:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826816 00000100:00100000:3.0:1788890952.072510:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 229 00000100:00100000:3.0:1788890952.072520:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987826816:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890952.072755:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987826816:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 Request processed in 236us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890952.072763:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 229 00000100:00100000:3.0:1788890952.759779:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996246656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788890952.759843:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890952.760016:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996246656 00000100:00100000:1.0:1788890952.760024:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996246656 00000100:00100000:1.0:1788890952.760089:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788890952.760101:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996246656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788890952.760137:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890952.760208:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996246656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890952.760215:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788890952.760353:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788890952.760383:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bc9f80 x1875787996246656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890952.760402:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996246656:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788890952.763161:0:11342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788890952.825826:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890953.849476:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890954.294562:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996246784:0@lo:400:kworker.0 00000100:00100000:2.0:1788890954.294585:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996246912:0@lo:400:kworker.0 00000100:00100000:1.0:1788890954.294588:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996247168:0@lo:400:kworker.0 00000100:00100000:3.0:1788890954.294633:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996247040:0@lo:400:kworker.0 00000100:00100000:0.0:1788890954.294658:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890954.294664:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890954.294727:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890954.294728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890954.294735:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996247296:0@lo:400:kworker.0 00000100:00100000:2.0:1788890954.294736:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996247424:0@lo:400:kworker.0 00000100:00100000:0.0:1788890954.294789:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890954.294793:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890954.294822:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996246784 00000100:00100000:1.0:1788890954.294822:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996246912 00000100:00100000:1.0:1788890954.294837:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996246912 00000100:00100000:0.0:1788890954.294837:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996247040 00000100:00100000:3.0:1788890954.294838:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996246784 00000100:00100000:0.0:1788890954.294842:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996247040 00000100:00100000:2.0:1788890954.294853:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996247168 00000100:00100000:2.0:1788890954.294860:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996247168 00000100:00100000:0.0:1788890954.294890:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996247296 00000100:00100000:3.0:1788890954.294892:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788890954.294896:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996247296 00000100:00100000:3.0:1788890954.294911:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996246784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890954.294922:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788890954.294936:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996247424 00000100:00100000:0.0:1788890954.294939:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788890954.294942:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996247040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890954.294945:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996247424 00000100:00100000:0.0:1788890954.294962:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996246912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890954.294978:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996246784:12345-0@lo:400:kworker.0 Request processed in 77us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890954.294985:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788890954.295012:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788890954.295027:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996247168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890954.295036:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788890954.295043:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996247040:12345-0@lo:400:kworker.0 Request processed in 105us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890954.295049:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996246912:12345-0@lo:400:kworker.0 Request processed in 95us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890954.295051:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788890954.295071:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788890954.295083:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996247168:12345-0@lo:400:kworker.0 Request processed in 61us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890954.295100:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788890954.295104:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788890954.295130:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788890954.295138:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788890954.295148:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996247296:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788890954.295150:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788890954.295159:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996247424:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788890954.295160:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788890954.295198:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890954.295241:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996246912:0@lo:400:kworker.0 00000100:00100000:1.0:1788890954.295249:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996247296:12345-0@lo:400:kworker.0 Request processed in 106us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890954.295262:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996247424:12345-0@lo:400:kworker.0 Request processed in 106us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890954.295269:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1788890954.295281:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201fa0e00 x1875787996247424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890954.295289:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788890954.295299:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996247424:0@lo:400:kworker.0 00000100:00100000:3.0:1788890954.295311:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996247040:0@lo:400:kworker.0 00000100:00100000:0.0:1788890954.295334:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996247296:0@lo:400:kworker.0 00010000:00080000:1.0:1788890954.295360:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1d0756a00 x1875787996247168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890954.295365:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996246784:0@lo:400:kworker.0 00000100:00100000:1.0:1788890954.295389:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996247168:0@lo:400:kworker.0 00000001:02000400:0.0:1788890954.596800:0:11442:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:09:14 (1788890954) === 00000100:00100000:2.0:1788890954.699905:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890954.700065:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890954.700135:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987826944 00000100:00100000:0.0:1788890954.700145:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987826944 00000100:00100000:0.0:1788890954.700228:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:0.0:1788890954.700238:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987826944:12345-192.168.204.18@tcp:41:mkdir.0 00000004:00000024:0.0:1788890954.700279:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788890954.700369:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987826944:12345-192.168.204.18@tcp:41:mkdir.0 Request processed in 132us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890954.700377:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:0.0:1788890954.700423:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827072 00000100:00100000:0.0:1788890954.700426:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827072 00000100:00100000:0.0:1788890954.700449:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:0.0:1788890954.700454:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:9702:x1875787987827072:12345-192.168.204.18@tcp:700:mkdir.0 00000100:00100000:0.0:1788890954.700486:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:9702:x1875787987827072:12345-192.168.204.18@tcp:700:mkdir.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890954.700491:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00080000:1.0:1788890954.700649:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890954.704041:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890954.704134:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827328 00000100:00100000:1.0:1788890954.704142:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827328 00000100:00100000:1.0:1788890954.704281:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00100000:1.0:1788890954.704293:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:9702:x1875787987827328:12345-192.168.204.18@tcp:36:mkdir.0 00010000:00010000:1.0:1788890954.704420:0:6852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890954.704483:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3ee0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bc7 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.704504:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:1.0:1788890954.704516:0:6852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890954.704848:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.704862:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.704872:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.704896:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.704904:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.704912:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890954.706400:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788890954.706413:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.706423:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.706432:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.706439:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890954.706443:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.706450:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.706463:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:1.0:1788890954.706467:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890954.706472:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.706488:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890954.706505:0:6852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a2c69d5 reply state 00000000aae0f74e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890954.706514:0:6852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788890954.706710:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:9702:x1875787987827328:12345-192.168.204.18@tcp:36:mkdir.0 Request processed in 2416us (2676us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788890954.706718:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 15 00010000:00010000:1.0:1788890954.713352:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.713368:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.713375:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.713382:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6ec00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890954.713386:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.713393:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.713409:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9da1c32fc600) 00010000:00010000:1.0:1788890954.713412:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890954.713417:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.713431:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef35 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890954.715199:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890954.716517:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827456 00000100:00100000:2.0:1788890954.716527:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827456 00000100:00100000:2.0:1788890954.716599:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:2.0:1788890954.716611:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:9703:x1875787987827456:12345-192.168.204.18@tcp:101:chmod.0 00010000:00010000:2.0:1788890954.716632:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890954.716652:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3ef3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c4c expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.716727:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3ef43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.716741:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3ef43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.716754:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3ef43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890954.716800:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788890954.716804:0:11412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890954.716839:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3ef43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.716864:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3ef3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c4c expref: 8 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.716880:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3ef43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c4c expref: 7 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.716889:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:2.0:1788890954.716891:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890954.716895:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87600, rc 0) 00000100:00100000:2.0:1788890954.716963:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:9703:x1875787987827456:12345-192.168.204.18@tcp:101:chmod.0 Request processed in 354us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890954.716970:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:2.0:1788890954.721529:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890954.721626:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827712 00000100:00100000:0.0:1788890954.721636:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827712 00000100:00100000:1.0:1788890954.721712:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:1.0:1788890954.721736:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:9703:x1875787987827712:12345-192.168.204.18@tcp:36:chmod.0 00010000:00010000:1.0:1788890954.721795:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890954.721824:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3ef43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c4c expref: 7 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.721854:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:1.0:1788890954.721865:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890954.721889:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.721903:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.721913:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890954.722635:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd8ff40a reply state 00000000414f6cfd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890954.722647:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788890954.722656:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788890954.722786:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:9703:x1875787987827712:12345-192.168.204.18@tcp:36:chmod.0 Request processed in 1050us (1263us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788890954.722794:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 17 00010000:00010000:2.0:1788890954.724250:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.724266:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.724275:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.724283:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6ec00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890954.724296:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.724305:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.724320:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc600) 00010000:00010000:2.0:1788890954.724323:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788890954.724327:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.724333:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6ec00/0x9161b78f8ec3ef4a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890954.737383:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890954.737476:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827840 00000100:00100000:1.0:1788890954.737488:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827840 00000100:00100000:1.0:1788890954.737554:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:1.0:1788890954.737565:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:9704:x1875787987827840:12345-192.168.204.18@tcp:101:chown.0 00010000:00010000:1.0:1788890954.737592:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890954.737616:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c53 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.737755:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3ef58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.737770:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3ef58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.737781:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3ef58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890954.737816:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788890954.737820:0:6852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788890954.737857:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3ef58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.737882:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c53 expref: 9 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.737899:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3ef58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c53 expref: 8 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.737907:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:1.0:1788890954.737911:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788890954.737927:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f200, rc 0) 00000100:00100000:1.0:1788890954.738218:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:9704:x1875787987827840:12345-192.168.204.18@tcp:101:chown.0 Request processed in 497us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890954.738226:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:3.0:1788890954.740145:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890954.740325:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987827968 00000100:00100000:0.0:1788890954.740334:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987827968 00000100:00100000:0.0:1788890954.740768:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:0.0:1788890954.740779:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:9704:x1875787987827968:12345-192.168.204.18@tcp:101:chown.0 00010000:00010000:0.0:1788890954.740797:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890954.740820:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c5a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.740894:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.740907:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.740919:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.740933:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.740950:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.740974:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741067:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3ef74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741076:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3ef74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741082:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3ef74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890954.741110:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788890954.741114:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890954.741133:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3ef74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741145:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741151:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741157:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741163:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890954.741190:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741197:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741216:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:0.0:1788890954.741219:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890954.741223:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741228:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741240:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741246:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741252:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741257:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890954.741260:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741267:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741274:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9da1c870c300) 00010000:00010000:0.0:1788890954.741276:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890954.741279:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741284:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741325:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c5a expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741338:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3ef74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c5a expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.741346:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870cf00) 00010000:00010000:0.0:1788890954.741348:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788890954.741350:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031200, rc 0) 00000100:00100000:0.0:1788890954.741414:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:9704:x1875787987827968:12345-192.168.204.18@tcp:101:chown.0 Request processed in 637us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890954.741421:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:0.0:1788890954.744963:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890954.745018:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828224 00000100:00100000:1.0:1788890954.745027:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828224 00000100:00100000:1.0:1788890954.745086:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 20 00000100:00100000:1.0:1788890954.745095:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:9704:x1875787987828224:12345-192.168.204.18@tcp:36:chown.0 00010000:00010000:1.0:1788890954.745144:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890954.745204:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3ef74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c5a expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.745226:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870cf00) 00010000:00010000:1.0:1788890954.745236:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890954.745262:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.745273:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.745282:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890954.774264:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db092297 reply state 000000006b914917 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890954.774284:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788890954.774299:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788890954.774417:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:9704:x1875787987828224:12345-192.168.204.18@tcp:36:chown.0 Request processed in 29319us (29458us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788890954.774444:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 20 00000001:00080000:2.0:1788890954.775076:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1788890954.775202:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.775213:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.775221:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.775229:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890954.775234:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.775240:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.775269:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:0.0:1788890954.775272:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788890954.775277:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.775283:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3ef7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890954.789112:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890954.789213:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828352 00000100:00100000:1.0:1788890954.789223:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828352 00000100:00100000:1.0:1788890954.789278:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:1.0:1788890954.789287:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:9705:x1875787987828352:12345-192.168.204.18@tcp:101:touch.500 00010000:00010000:1.0:1788890954.789310:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890954.789329:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3ef82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c61 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788890954.790532:0:6852:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1158us 00010000:00010000:0.0:1788890954.804260:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804284:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804297:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804314:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804322:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804328:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804667:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804676:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804690:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890954.804712:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788890954.804716:0:6852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890954.804756:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804768:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804775:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804782:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804788:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890954.804792:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804800:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804811:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:0.0:1788890954.804814:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890954.804819:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804825:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3ef89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804860:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804865:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804871:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804877:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890954.804880:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804885:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804893:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9da1c870c300) 00010000:00010000:0.0:1788890954.804896:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890954.804899:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804904:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3ef90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804952:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3ef82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c61 expref: 8 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804971:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c61 expref: 7 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.804990:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870c400) 00010000:00010000:0.0:1788890954.804993:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788890954.804995:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031400, rc 0) 00000100:00100000:0.0:1788890954.805065:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:9705:x1875787987828352:12345-192.168.204.18@tcp:101:touch.500 Request processed in 15777us (15963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890954.805074:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:1.0:1788890954.807437:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890954.807460:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996247552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890954.807525:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890954.807808:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996247552 00000100:00100000:2.0:1788890954.807816:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996247552 00000100:00100000:2.0:1788890954.807871:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788890954.808764:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996247552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788890954.808802:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788890954.809143:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996247552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1262us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890954.809152:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788890954.809203:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890954.809886:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828608 00000100:00100000:2.0:1788890954.809894:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828608 00000100:00100000:2.0:1788890954.809949:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 22 00000100:00100000:2.0:1788890954.809959:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:9705:x1875787987828608:12345-192.168.204.18@tcp:101:touch.500 00010000:00010000:2.0:1788890954.809988:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890954.810006:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3ef9e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.810263:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.810278:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.810288:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.810354:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.810362:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.810369:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788890954.811025:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788890954.811285:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3efb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811295:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3efb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811304:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3efb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811346:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811354:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811361:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811367:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890954.811371:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811378:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811390:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870c400) 00010000:00010000:2.0:1788890954.811393:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890954.811398:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811404:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efa5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890954.811416:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5447b03 reply state 00000000af5934d7 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890954.811424:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788890954.811453:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3ef9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c68 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811475:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3efb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c68 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.811482:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890954.811485:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890954.811487:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87200, rc 0) 00000100:00100000:2.0:1788890954.811547:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:9705:x1875787987828608:12345-192.168.204.18@tcp:101:touch.500 Request processed in 1590us (2347us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788890954.811555:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 22 00010000:00010000:2.0:1788890954.815456:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.815473:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.815480:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.815487:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890954.815491:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.815499:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.815514:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff9da1c2aee000) 00010000:00010000:2.0:1788890954.815517:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890954.815521:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.815548:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3efac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788890954.816349:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c592ad80 x1875787996247552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890954.816371:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996247552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890954.817775:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890954.823019:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828864 00000100:00100000:1.0:1788890954.823032:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828864 00000100:00100000:0.0:1788890954.823192:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:0.0:1788890954.823203:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:9705:x1875787987828864:12345-192.168.204.18@tcp:36:touch.500 00010000:00010000:0.0:1788890954.823258:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890954.823284:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3efb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c68 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.823303:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890954.823314:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890954.823373:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.823385:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.823403:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890954.823526:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007906c1e7 reply state 000000006c259f29 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890954.825982:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890954.826113:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:9705:x1875787987828864:12345-192.168.204.18@tcp:36:touch.500 Request processed in 2906us (8339us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788890954.826122:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:0.0:1788890954.828477:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00010000:00010000:1.0:1788890954.828560:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.828573:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.828580:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.828586:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890954.828590:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.828598:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.828631:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9da1c870c300) 00010000:00010000:1.0:1788890954.828634:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890954.828638:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.828644:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3efc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890954.828852:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987828992 00000100:00100000:2.0:1788890954.828861:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987828992 00000100:00100000:2.0:1788890954.828920:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 24 00000100:00100000:2.0:1788890954.828930:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:9705:x1875787987828992:12345-192.168.204.18@tcp:101:touch.500 00010000:00010000:2.0:1788890954.828962:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890954.828978:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3efc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c6f expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.829029:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3efc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c6f expref: 10 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.829041:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3efc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c6f expref: 10 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.829056:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890954.829059:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890954.829062:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86800, rc 0) 00000100:00100000:2.0:1788890954.829115:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:9705:x1875787987828992:12345-192.168.204.18@tcp:101:touch.500 Request processed in 186us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890954.829122:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 24 00000100:00100000:1.0:1788890954.833874:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890954.834080:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829120 00000100:00100000:2.0:1788890954.834090:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829120 00000100:00100000:2.0:1788890954.834258:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:2.0:1788890954.834267:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875787987829120:12345-192.168.204.18@tcp:8:touch.500 00010000:00080000:2.0:1788890954.834310:0:6662:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1788890954.834338:0:6662:0:(genops.c:1385:class_connect()) connect: client 671ae218-3c0c-4db9-9d11-9d6b732a0de5, cookie 0x9161b78f8ec3efcf 00002000:00100000:2.0:1788890954.834349:0:6662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 671ae218-3c0c-4db9-9d11-9d6b732a0de5/ffff9da1f4c1a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788890954.834369:0:6662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788890954.834636:0:6662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788890954.834665:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9da1ffeb9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788890954.834749:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2371:x1875787987829120:12345-192.168.204.18@tcp:8:touch.500 Request processed in 481us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890954.834758:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:0.0:1788890954.836434:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890954.836540:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829248 00000100:00100000:1.0:1788890954.836547:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829248 00000100:00100000:1.0:1788890954.836636:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00100000:1.0:1788890954.836645:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:0:x1875787987829248:12345-192.168.204.18@tcp:2:touch.500 00000100:00080000:0.0:1788890954.836975:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788890954.863694:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1788890954.863936:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:0:x1875787987829248:12345-192.168.204.18@tcp:2:touch.500 Request processed in 27286us (27502us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788890954.863959:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 15 00000001:00100000:0.0:1788890954.864438:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000100:00100000:3.0:1788890954.865729:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890954.865811:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829504 00000100:00100000:1.0:1788890954.865820:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829504 00000100:00100000:1.0:1788890954.865872:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:1.0:1788890954.865882:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:9705:x1875787987829504:12345-192.168.204.18@tcp:35:touch.500 00000100:00100000:1.0:1788890954.866515:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:9705:x1875787987829504:12345-192.168.204.18@tcp:35:touch.500 Request processed in 631us (788us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788890954.866523:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 2 00010000:00010000:0.0:1788890954.871750:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890954.875351:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890954.876075:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829632 00000100:00100000:0.0:1788890954.876088:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829632 00000100:00100000:0.0:1788890954.876248:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 25 00000100:00100000:0.0:1788890954.876259:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:9706:x1875787987829632:12345-192.168.204.18@tcp:101:rm.0 00010000:00010000:0.0:1788890954.876284:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890954.876304:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3efd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.876368:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3efdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.876382:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3efdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.876408:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3efdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890954.876439:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788890954.876442:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890954.876497:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3efdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.876526:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3efd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c76 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.876544:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3efdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c76 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.876552:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870c400) 00010000:00010000:0.0:1788890954.876555:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788890954.876558:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031600, rc 0) 00000100:00100000:0.0:1788890954.876616:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+12:9706:x1875787987829632:12345-192.168.204.18@tcp:101:rm.0 Request processed in 360us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890954.876624:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 25 00000100:00100000:0.0:1788890954.879693:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890954.879778:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987829888 00000100:00100000:2.0:1788890954.879786:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987829888 00000100:00100000:2.0:1788890954.879842:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 26 00000100:00100000:2.0:1788890954.879853:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+12:9706:x1875787987829888:12345-192.168.204.18@tcp:101:rm.0 00010000:00010000:2.0:1788890954.879871:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890954.879891:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c7d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890954.880726:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788890954.880841:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efe4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c7d expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.880856:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:2.0:1788890954.880858:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788890954.880863:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3efe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c7d expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.880894:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86c00, rc 0) 00000100:00100000:2.0:1788890954.881012:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:9706:x1875787987829888:12345-192.168.204.18@tcp:101:rm.0 Request processed in 1160us (1598us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788890954.881020:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 26 00000100:00100000:3.0:1788890954.884363:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890954.884460:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830016 00000100:00100000:2.0:1788890954.884470:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830016 00000100:00100000:2.0:1788890954.884524:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:2.0:1788890954.884535:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:9706:x1875787987830016:12345-192.168.204.18@tcp:37:rm.0 00000100:00100000:2.0:1788890954.889844:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:9706:x1875787987830016:12345-192.168.204.18@tcp:37:rm.0 Request processed in 5301us (5479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890954.889861:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:0.0:1788890954.893881:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890954.893965:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830272 00000100:00100000:1.0:1788890954.893975:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830272 00000100:00100000:1.0:1788890954.894317:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:1.0:1788890954.894328:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:9706:x1875787987830272:12345-192.168.204.18@tcp:35:rm.0 00000100:00100000:1.0:1788890954.894552:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:9706:x1875787987830272:12345-192.168.204.18@tcp:35:rm.0 Request processed in 226us (775us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788890954.894560:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:3.0:1788890954.899556:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890954.899658:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830528 00000100:00100000:2.0:1788890954.899934:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830528 00000100:00100000:2.0:1788890954.900009:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:2.0:1788890954.900020:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:9706:x1875787987830528:12345-192.168.204.18@tcp:101:rm.0 00010000:00010000:2.0:1788890954.900043:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890954.900064:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3eff2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c84 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.900207:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3eff9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.900222:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3eff9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.900245:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3eff9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890954.900271:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788890954.900433:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3eff2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c84 expref: 17 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.900452:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3eff9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c84 expref: 16 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.900462:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870c400) 00010000:00010000:2.0:1788890954.900465:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788890954.900468:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87000, rc 0) 00000100:00100000:2.0:1788890954.900530:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:9706:x1875787987830528:12345-192.168.204.18@tcp:101:rm.0 Request processed in 512us (989us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788890954.900537:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:3.0:1788890954.903807:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890954.903949:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830656 00000100:00100000:0.0:1788890954.903959:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830656 00000100:00100000:0.0:1788890954.904063:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 28 00000100:00100000:0.0:1788890954.904075:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:9706:x1875787987830656:12345-192.168.204.18@tcp:41:rm.0 00000004:00000024:0.0:1788890954.904134:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788890954.904278:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:9706:x1875787987830656:12345-192.168.204.18@tcp:41:rm.0 Request processed in 205us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890954.904286:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 28 00000100:00100000:0.0:1788890954.906443:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890954.906496:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987830784 00000100:00100000:2.0:1788890954.906505:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987830784 00000100:00100000:2.0:1788890954.906623:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 29 00000100:00100000:2.0:1788890954.907498:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:9706:x1875787987830784:12345-192.168.204.18@tcp:101:rm.0 00010000:00010000:2.0:1788890954.907520:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890954.907552:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f007 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c8b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907615:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907638:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907668:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907683:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907703:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907709:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907800:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f01c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907808:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907815:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890954.907854:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788890954.907859:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890954.907877:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907888:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907896:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907913:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907920:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907926:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890954.907930:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907947:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907960:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870c400) 00010000:00010000:2.0:1788890954.907963:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890954.907968:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907974:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f00e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907987:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.907993:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.908000:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.908005:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890954.908014:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.908021:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.908029:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff9da1c2aee100) 00010000:00010000:2.0:1788890954.908032:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890954.908035:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.908041:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f015 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.908073:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f007 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c8b expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.908086:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f01c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c8b expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.908093:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890954.908095:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890954.908098:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87800, rc 0) 00000100:00100000:2.0:1788890954.908259:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:9706:x1875787987830784:12345-192.168.204.18@tcp:101:rm.0 Request processed in 1574us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890954.908267:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 29 00000100:00100000:3.0:1788890954.911027:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890954.911989:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831040 00000100:00100000:1.0:1788890954.911999:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831040 00000100:00100000:1.0:1788890954.912057:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 30 00000100:00100000:1.0:1788890954.912068:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:9706:x1875787987831040:12345-192.168.204.18@tcp:36:rm.0 00010000:00010000:1.0:1788890954.912114:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788890954.912137:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f01c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c8b expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912158:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3efc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c6f expref: 16 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912299:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:1.0:1788890954.912374:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3efdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c76 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912385:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870c400) 00010000:00010000:1.0:1788890954.912388:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890954.912407:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912421:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912431:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912455:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912462:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912469:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912645:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912654:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.912662:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788890954.914010:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788890954.914022:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 178762853514ns, next at 179762850898ns, rc = 0 00010000:00010000:1.0:1788890954.914085:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914096:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914104:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914112:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914128:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914133:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914214:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788890954.914234:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914239:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914245:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914250:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890954.914254:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914261:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914271:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9da1c32fcd00) 00010000:00010000:1.0:1788890954.914274:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788890954.914278:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914283:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f031 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914296:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914317:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914322:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914327:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fa00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890954.914330:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914335:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914343:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870c400) 00010000:00010000:1.0:1788890954.914345:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890954.914348:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.914354:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f023 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890954.914364:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dfa5203 reply state 0000000018c86930 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890954.914372:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788890954.914449:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:9706:x1875787987831040:12345-192.168.204.18@tcp:36:rm.0 Request processed in 2380us (3427us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788890954.914458:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 30 00010000:00010000:2.0:1788890954.915042:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890954.915050:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.915068:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e000 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890954.915071:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.915078:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.915088:0:6678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9da1c32fcd00) 00010000:00010000:2.0:1788890954.915090:0:6678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788890954.915093:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.915156:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f038 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.915284:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890954.915287:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890954.915289:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890954.917621:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.917637:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.917645:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.917652:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890954.917656:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.917680:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.917695:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff9da1c32fc000) 00010000:00010000:2.0:1788890954.917699:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890954.917703:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890954.917711:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f02a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890954.920638:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890954.920688:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831296 00000100:00100000:2.0:1788890954.920697:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831296 00000100:00100000:2.0:1788890954.920745:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:2.0:1788890954.920753:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:9706:x1875787987831296:12345-192.168.204.18@tcp:35:rm.0 00000100:00100000:2.0:1788890954.920971:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:9706:x1875787987831296:12345-192.168.204.18@tcp:35:rm.0 Request processed in 217us (342us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788890954.920979:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:3.0:1788890954.925323:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890954.925673:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831552 00000100:00100000:0.0:1788890954.925684:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831552 00000100:00100000:0.0:1788890954.925753:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 31 00000100:00100000:0.0:1788890954.925765:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:9706:x1875787987831552:12345-192.168.204.18@tcp:36:rm.0 00010000:00010000:0.0:1788890954.925820:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788890954.925846:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3eff9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c84 expref: 16 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.925867:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec3ef97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c61 expref: 15 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.925878:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870c400) 00010000:00010000:0.0:1788890954.925893:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3ef58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c53 expref: 14 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.925902:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:0.0:1788890954.925909:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890954.925932:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.925957:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.925968:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.925994:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926002:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926010:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926275:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926284:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926292:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890954.926833:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788890954.926849:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926856:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926863:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926869:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890954.926874:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926890:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926899:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9da1c870c300) 00010000:00010000:0.0:1788890954.926902:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788890954.926906:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926912:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec3f04d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926928:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926934:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926952:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926957:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890954.926960:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926966:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926974:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c000) 00010000:00010000:0.0:1788890954.926976:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890954.926979:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890954.926994:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec3f03f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890954.927008:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023b3c699 reply state 0000000007f3a062 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890954.927017:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890954.927095:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:9706:x1875787987831552:12345-192.168.204.18@tcp:36:rm.0 Request processed in 1332us (1780us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788890954.927103:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 31 00010000:00010000:1.0:1788890954.928832:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.928863:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.928871:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.928876:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890954.928879:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.928886:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.928899:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9da1c870c200) 00010000:00010000:1.0:1788890954.928902:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890954.928910:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890954.928917:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f046 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890955.896054:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890956.014145:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890956.014259:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890956.014291:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890956.014312:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890956.014378:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831680 00000100:00100000:2.0:1788890956.014387:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831680 00000100:00100000:2.0:1788890956.014441:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 231 00000100:00100000:2.0:1788890956.014450:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987831680:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890956.014515:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987831680:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 66us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890956.014523:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 231 00000100:00100000:2.0:1788890956.014554:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831808 00000100:00100000:2.0:1788890956.014557:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831808 00000100:00100000:2.0:1788890956.014598:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832064 00000100:00100000:2.0:1788890956.014602:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832064 00000100:00100000:2.0:1788890956.014624:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 70 00000100:00100000:2.0:1788890956.014631:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:2374:x1875787987831808:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890956.014663:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:2374:x1875787987831808:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 34us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890956.014670:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 70 00000100:00100000:2.0:1788890956.014681:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 71 00000100:00100000:2.0:1788890956.014687:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2374:x1875787987832064:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890956.014708:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2374:x1875787987832064:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 22us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890956.014715:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 71 00000100:00100000:0.0:1788890956.014913:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987831936 00000100:00100000:0.0:1788890956.014928:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987831936 00000100:00100000:0.0:1788890956.015077:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:0.0:1788890956.015085:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987831936:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890956.015116:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987831936:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 33us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890956.015122:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00080000:0.0:1788890956.015137:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788890956.015141:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890956.017435:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890956.017497:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832192 00000100:00100000:1.0:1788890956.017505:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832192 00000100:00100000:1.0:1788890956.017566:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:1.0:1788890956.017576:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2371:x1875787987832192:12345-192.168.204.18@tcp:9:kworker.0 00000020:00000080:1.0:1788890956.017599:0:6663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eee1 00000100:00080000:1.0:1788890956.017606:0:6663:0:(import.c:65:import_set_state_nolock()) ffff9da0c1182000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788890956.017639:0:6663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788890956.017877:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:852e3539-1359-4cf9-b701-3f696e6c6e5e+2:2371:x1875787987832192:12345-192.168.204.18@tcp:9:kworker.0 Request processed in 302us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890956.017891:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00080000:0.0:1788890956.018060:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788890956.018071:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890956.018361:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890956.018413:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832320 00000100:00100000:1.0:1788890956.018418:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832320 00000100:00100000:1.0:1788890956.018462:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:1.0:1788890956.018470:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2371:x1875787987832320:12345-192.168.204.18@tcp:9:kworker.0 00000020:00000080:1.0:1788890956.018484:0:6664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eee8 00000100:00080000:1.0:1788890956.018489:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9da0c1180800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788890956.018512:0:6664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788890956.018734:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+2:2371:x1875787987832320:12345-192.168.204.18@tcp:9:kworker.0 Request processed in 264us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890956.018741:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 17 00010000:00010000:1.0:1788890956.018756:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788890956.018792:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788890956.920057:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788890957.178244:0:11593:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1788890957.879331:0:6851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 181728155792ns, next at 182728152389ns, rc = 0 00000100:00100000:2.0:1788890957.879373:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890957.879403:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996247680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788890957.879500:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890957.879556:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996247680 00000100:00100000:3.0:1788890957.879566:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996247680 00000100:00100000:3.0:1788890957.879643:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788890957.879663:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996247680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890957.879706:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890957.879765:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996247680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890957.879774:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788890957.879801:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788890957.879802:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201fa3b80 x1875787996247680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890957.879952:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996247680:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788890957.918763:0:11641:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff83e3c70 20000000:00000080:2.0:1788890957.918904:0:11641:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9da1c5687400 uarg=0000000000000000 20000000:01000000:2.0:1788890957.919023:0:11641:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788890957.919031:0:11641:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788890957.919037:0:11641:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788890957.920548:0:11642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788890957.920752:0:11641:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788890957.928998:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788890957.929061:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788890957.929155:0:11641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788890957.929204:0:11641:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788890957.929230:0:11641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929262:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3eef6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929271:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ef04 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929278:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ef12 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929286:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c3e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929291:0:11641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c45 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929297:0:11641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929339:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c45 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929354:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c45 expref: 12 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890957.929368:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996247808:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890957.929486:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c3e expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929501:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c3e expref: 12 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890957.929509:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb28a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996247936:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890957.929541:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ef12 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929548:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ef12 expref: 18 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890957.929557:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996248064:0@lo:104: 00000100:00100000:0.0:1788890957.929602:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788890957.929648:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ef04 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929657:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ef04 expref: 18 pid: 5808 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890957.929665:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996248192:0@lo:104: 00000100:00100000:2.0:1788890957.929683:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996248064 00000100:00100000:0.0:1788890957.929686:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890957.929697:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996248064 00010000:00010000:0.0:1788890957.929721:0:11641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3eef6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.929729:0:11641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3eef6 expref: 18 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890957.929736:0:11641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996248320:0@lo:104: 00000100:00100000:2.0:1788890957.929771:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996248192 00000100:00100000:2.0:1788890957.929774:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996248192 00000100:00100000:0.0:1788890957.929775:0:11641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890957.929797:0:11641:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0f27840 going to sleep for 11 seconds 00000100:00100000:2.0:1788890957.930370:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996248320 00000100:00100000:2.0:1788890957.930378:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996248320 00000100:00100000:2.0:1788890957.930401:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788890957.930412:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+5:11641:x1875787996248064:12345-0@lo:104: 00010000:00010000:2.0:1788890957.930428:0:6677:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.930506:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788890957.930513:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+5:11641:x1875787996248064:12345-0@lo:104: Request processed in 103us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890957.930520:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788890957.930539:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890957.930545:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+4:11641:x1875787996248192:12345-0@lo:104: 00010000:00010000:2.0:1788890957.930552:0:6677:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.930666:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788890957.930673:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+4:11641:x1875787996248192:12345-0@lo:104: Request processed in 128us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890957.930678:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788890957.930693:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788890957.930699:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+3:11641:x1875787996248320:12345-0@lo:104: 00010000:00010000:2.0:1788890957.930706:0:6677:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.930919:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788890957.930936:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:68b804f9-71ae-42dc-a11e-677332e27dfa+3:11641:x1875787996248320:12345-0@lo:104: Request processed in 237us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890957.930943:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788890957.930971:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788890957.930979:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.930987:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86a00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788890957.930992:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931001:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890957.931008:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890957.931014:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788890957.931056:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931062:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890957.931087:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931094:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86a00/0x9161b78f8ec3ef12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ef19 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931112:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788890957.931116:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931132:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87a00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788890957.931135:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931141:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890957.931147:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890957.931151:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788890957.931187:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890957.931188:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996248064:0@lo:104: 00010000:00010000:2.0:1788890957.931193:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788890957.931201:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996248192:0@lo:104: 00000100:00100000:0.0:1788890957.931208:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996248320:0@lo:104: 00010000:00010000:2.0:1788890957.931213:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931220:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3ef04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ef0b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931229:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890957.931232:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931238:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87400 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788890957.931241:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931260:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788890957.931266:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788890957.931271:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788890957.931285:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931291:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788890957.931298:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931305:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87400/0x9161b78f8ec3eef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3eefd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.931320:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890957.931322:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890957.931324:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890957.931331:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890957.931357:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996248448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788890957.931402:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890957.931506:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996248576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788890957.931530:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890957.931713:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788890957.931721:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996248704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788890957.931929:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890957.931954:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996248448 00000100:00100000:0.0:1788890957.931963:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996248448 00010000:00010000:0.0:1788890957.931998:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ef12 expref: 19 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890957.932028:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996248576 00000100:00100000:0.0:1788890957.932032:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996248576 00010000:00010000:0.0:1788890957.932045:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ef04 expref: 20 pid: 5808 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890957.932064:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788890957.932072:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+20:3280:x1875787996248448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788890957.932088:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890957.932095:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ef12 expref: 20 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.932105:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ef12 expref: 20 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.932121:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec3ef19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ef12 expref: 20 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.932140:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890957.932202:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996248448:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890957.932209:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788890957.932235:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788890957.932241:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+18:3281:x1875787996248576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788890957.932249:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890957.932254:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ef04 expref: 18 pid: 5808 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.932262:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ef04 expref: 18 pid: 5808 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.932273:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6e600/0x9161b78f8ec3ef0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ef04 expref: 18 pid: 5808 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.932282:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890957.932305:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:3281:x1875787996248576:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890957.932311:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788890957.933141:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996248576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788890957.933198:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996248448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788890957.933220:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996248704 00000100:00100000:2.0:1788890957.933224:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996248704 00010000:00010000:2.0:1788890957.933248:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eef6 expref: 17 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890957.933274:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788890957.933281:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:3281:x1875787996248704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788890957.933292:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890957.933297:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3eef6 expref: 17 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.933306:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3eef6 expref: 17 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.933319:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1f4edcc00/0x9161b78f8ec3eefd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3eef6 expref: 17 pid: 5807 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890957.933331:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890957.933369:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68b804f9-71ae-42dc-a11e-677332e27dfa+16:3281:x1875787996248704:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890957.933376:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788890957.933401:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996248704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788890957.933471:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890957.938111:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890957.938262:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890957.938311:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832448 00000100:00100000:3.0:1788890957.938324:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832448 00000100:00100000:1.0:1788890957.938327:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832576 00000100:00100000:1.0:1788890957.938330:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832576 00010000:00010000:3.0:1788890957.938431:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c45 expref: 14 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890957.938469:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996247808:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890957.938489:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 32 00000100:00100000:3.0:1788890957.938501:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47df6031-18d1-4179-91e9-917028d5aced+14:2374:x1875787987832448:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890957.938521:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890957.938528:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c45 expref: 14 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890957.938542:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c45 expref: 14 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890957.938563:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3ef27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c45 expref: 14 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890957.938570:0:11641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb28a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11641:1875787996247936:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890957.938584:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890957.938619:0:11641:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890957.938650:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987832448:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 150us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890957.938659:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 32 00010000:00010000:1.0:1788890957.939954:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c3e expref: 13 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890957.940014:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:1.0:1788890957.940034:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+13:2375:x1875787987832576:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890957.940050:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890957.940057:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c3e expref: 13 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940070:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c3e expref: 13 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940102:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec3ef20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c3e expref: 13 pid: 5810 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940120:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940129:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940147:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940155:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940162:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940185:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940193:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030a00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788890957.940199:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940209:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940292:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890957.940378:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890957.940430:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+11:2375:x1875787987832576:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 405us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890957.940439:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 33 00010000:00010000:0.0:1788890957.940465:0:11641:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.940478:0:11641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.940486:0:11641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec3f054 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890957.943482:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890958.966390:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890959.274544:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890959.274821:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832704 00000100:00100000:3.0:1788890959.274844:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832704 00000100:00100000:3.0:1788890959.274915:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 232 00000100:00100000:3.0:1788890959.274926:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+11:5603:x1875787987832704:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788890959.274944:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890959.274964:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3f05b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c92 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.274994:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3f05b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c92 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.275006:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3f05b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c92 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.275016:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd600, rc 0) 00000100:00100000:3.0:1788890959.275120:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987832704:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 Request processed in 196us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890959.275127:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 232 00000100:00100000:3.0:1788890959.277347:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890959.277431:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832832 00000100:00100000:0.0:1788890959.277439:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832832 00000100:00100000:0.0:1788890959.277495:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 233 00000100:00100000:0.0:1788890959.277504:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987832832:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890959.278385:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987832832:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 Request processed in 880us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.278394:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 233 00000100:00100000:0.0:1788890959.280896:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890959.281320:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987832960 00000100:00100000:1.0:1788890959.281329:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987832960 00000100:00100000:1.0:1788890959.281380:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 234 00000100:00100000:1.0:1788890959.281390:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987832960:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.281596:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987832960:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 Request processed in 206us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.281604:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 234 00000100:00100000:1.0:1788890959.284630:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890959.284997:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833088 00000100:00100000:0.0:1788890959.285006:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833088 00000100:00100000:0.0:1788890959.285070:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 235 00000100:00100000:0.0:1788890959.285081:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+12:9976:x1875787987833088:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788890959.285472:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+12:9976:x1875787987833088:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 393us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.285481:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 235 00000100:00100000:3.0:1788890959.288551:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890959.288634:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833216 00000100:00100000:1.0:1788890959.288642:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833216 00000100:00100000:1.0:1788890959.288692:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 236 00000100:00100000:1.0:1788890959.288701:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+12:9976:x1875787987833216:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788890959.288948:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+12:9976:x1875787987833216:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 247us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.288956:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 236 00000100:00100000:2.0:1788890959.292135:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890959.292205:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833344 00000100:00100000:0.0:1788890959.292213:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833344 00000100:00100000:0.0:1788890959.292335:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 237 00000100:00100000:0.0:1788890959.292345:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+12:5603:x1875787987833344:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890959.292563:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890959.292583:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3f062 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1c99 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890959.292609:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3f062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c99 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890959.292620:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3f062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c99 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890959.292644:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030800, rc 0) 00000100:00100000:0.0:1788890959.293783:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987833344:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 Request processed in 1435us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.293803:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 237 00000100:00100000:2.0:1788890959.301280:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890959.301425:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833472 00000100:00100000:1.0:1788890959.301433:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833472 00000100:00100000:1.0:1788890959.301482:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 238 00000100:00100000:1.0:1788890959.301491:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987833472:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.301749:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987833472:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 Request processed in 258us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.301757:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 238 00000100:00100000:3.0:1788890959.305476:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890959.305576:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833600 00000100:00100000:0.0:1788890959.305584:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833600 00000100:00100000:0.0:1788890959.305633:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 239 00000100:00100000:0.0:1788890959.305641:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987833600:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890959.305930:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:5603:x1875787987833600:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 Request processed in 288us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.305938:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 239 00000100:00100000:0.0:1788890959.312163:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890959.312358:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833728 00000100:00100000:2.0:1788890959.312369:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833728 00000100:00100000:2.0:1788890959.312423:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 240 00000100:00100000:2.0:1788890959.312432:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:9979:x1875787987833728:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788890959.312651:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:9979:x1875787987833728:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 219us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890959.312659:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 240 00000100:00100000:2.0:1788890959.314956:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890959.317748:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833856 00000100:00100000:0.0:1788890959.317763:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833856 00000100:00100000:0.0:1788890959.317890:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 241 00000100:00100000:0.0:1788890959.317902:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:9979:x1875787987833856:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788890959.318227:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:9979:x1875787987833856:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 326us (3276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.318235:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 241 00000100:00100000:3.0:1788890959.414468:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996249216:0@lo:400:kworker.0 00000100:00100000:3.0:1788890959.414550:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890959.414575:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996248832:0@lo:400:kworker.0 00000100:00100000:0.0:1788890959.414604:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996248960:0@lo:400:kworker.0 00000100:00100000:2.0:1788890959.414620:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890959.414649:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.414686:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996249088:0@lo:400:kworker.0 00000100:00100000:1.0:1788890959.414717:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890959.416343:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996249472:0@lo:400:kworker.0 00000100:00100000:3.0:1788890959.416352:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996249216 00000100:00100000:3.0:1788890959.416364:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996249216 00000100:00100000:1.0:1788890959.416373:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996248960 00000100:00100000:1.0:1788890959.416379:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996248960 00000100:00100000:0.0:1788890959.416413:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.416440:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996249088 00000100:00100000:1.0:1788890959.416444:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996249088 00000100:00100000:3.0:1788890959.416457:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996249472 00000100:00100000:3.0:1788890959.416462:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996249472 00000100:00100000:3.0:1788890959.416495:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788890959.416495:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996249344:0@lo:400:kworker.0 00000100:00100000:0.0:1788890959.416511:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788890959.416512:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996249216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890959.416530:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890959.416564:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996249344 00000100:00100000:2.0:1788890959.416568:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996249344 00000100:00100000:3.0:1788890959.416591:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996249216:12345-0@lo:400:kworker.0 Request processed in 83us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890959.416600:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788890959.416619:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788890959.416625:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788890959.416644:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996249472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890959.416794:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996249472:12345-0@lo:400:kworker.0 Request processed in 151us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890959.416801:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788890959.416820:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890959.418635:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996248960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890959.418662:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788890959.418673:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996249344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890959.418708:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996248960:12345-0@lo:400:kworker.0 Request processed in 2124us (4057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.418717:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788890959.418725:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996249344:12345-0@lo:400:kworker.0 Request processed in 54us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890959.418733:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788890959.418778:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996249344:0@lo:400:kworker.0 00010000:00080000:2.0:1788890959.418833:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201fa2a00 x1875787996249216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890959.418866:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996249216:0@lo:400:kworker.0 00000100:00100000:0.0:1788890959.418914:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996248832 00000100:00100000:0.0:1788890959.418921:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996248832 00000100:00080000:3.0:1788890959.418940:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788890959.418940:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996249088:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788890959.418947:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890959.418957:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788890959.418967:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:3279:x1875787996248832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890959.418992:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996249088:12345-0@lo:400:kworker.0 Request processed in 2365us (4273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.419000:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788890959.419018:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996249088:0@lo:400:kworker.0 00000100:00100000:0.0:1788890959.419024:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:3279:x1875787996248832:12345-0@lo:400:kworker.0 Request processed in 57us (4402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.419033:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788890959.419125:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996248832:0@lo:400:kworker.0 00000100:00100000:2.0:1788890959.421235:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996248960:0@lo:400:kworker.0 00010000:00080000:2.0:1788890959.421270:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201fa0a80 x1875787996249472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890959.421281:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996249472:0@lo:400:kworker.0 10000000:01000000:2.0:1788890959.862690:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788890959.862698:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1c5240800 from 7 10000000:01000000:2.0:1788890959.862703:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788890959.862758:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890959.862875:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890959.862888:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890959.862915:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996249600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788890959.862984:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890959.863059:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996249600 00000100:00100000:0.0:1788890959.863068:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996249600 00000100:00100000:0.0:1788890959.863124:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788890959.863133:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+16:5812:x1875787996249600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890959.863147:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890959.863163:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0031400/0x9161b78f8ec3f070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3f069 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890959.863164:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab86e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788890959.863225:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0031400/0x9161b78f8ec3f070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3f069 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890959.863237:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0031400/0x9161b78f8ec3f070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3f069 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890959.863248:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031400, rc 0) 00000100:00100000:0.0:1788890959.863287:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996249600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.863308:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788890959.863408:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996249600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788890959.863429:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890959.863438:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890959.863503:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996249728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890959.863531:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890959.863560:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab86e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890959.863588:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996249728 00000100:00100000:0.0:1788890959.863593:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996249728 00000100:00100000:0.0:1788890959.863625:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788890959.863632:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996249728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890959.863885:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996249728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.863892:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788890959.864007:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996249728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788890959.864035:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996249856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788890959.864073:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890959.864132:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab86e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890959.865916:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996249856 00000100:00100000:3.0:1788890959.865927:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996249856 00000100:00100000:3.0:1788890959.865980:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788890959.865990:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996249856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788890959.866264:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996249856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890959.866271:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788890959.868192:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996249856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890959.872351:0:11655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb35180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11655:1875787996249984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890959.872449:0:11655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890959.872565:0:11655:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201c54a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890959.879747:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996249984 00000100:00100000:3.0:1788890959.879770:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996249984 00000100:00100000:3.0:1788890959.880342:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788890959.880355:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f015c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:11655:x1875787996249984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890959.880675:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f015c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:11655:x1875787996249984:12345-0@lo:502:llog_process_th.0 Request processed in 322us (8225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890959.880700:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788890959.880808:0:11655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb35180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11655:1875787996249984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890959.880858:0:11655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788890959.880869:0:11655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890959.880872:0:11655:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788890959.880880:0:11655:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9da1c5240800 00000020:00000080:0.0:1788890959.880892:0:11655:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788890959.880992:0:11655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb35180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11655:1875787996250112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788890959.881046:0:11655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890959.881084:0:11655:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201c54a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890959.881410:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996250112 00000100:00100000:3.0:1788890959.881416:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996250112 00000100:00100000:3.0:1788890959.881449:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788890959.881456:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:11655:x1875787996250112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788890959.881581:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:11655:x1875787996250112:12345-0@lo:502:llog_process_th.0 Request processed in 125us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890959.881588:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788890959.882314:0:11655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb35180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11655:1875787996250112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788890959.882338:0:11655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788890959.882342:0:11655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788890959.882344:0:11655:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788890959.882347:0:11655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788890959.882496:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788890959.882514:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788890959.882522:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.882530:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788890959.882539:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788890959.882540:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1f4e26000 from 7 10000000:01000000:3.0:1788890959.882542:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788890959.882568:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.882573:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.882580:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890959.882592:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996250240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788890959.882629:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890959.882781:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1fb91c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788890959.882877:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996250240 00000100:00100000:0.0:1788890959.882952:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996250240 00000100:00100000:0.0:1788890959.883107:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788890959.883119:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+17:5812:x1875787996250240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788890959.883132:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890959.883144:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3f07e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3f077 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890959.883165:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3f07e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3f077 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890959.883201:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3f07e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3f077 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890959.883223:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031200, rc 0) 00000100:00100000:0.0:1788890959.883273:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996250240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.883280:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788890959.883357:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996250240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890959.883372:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.883383:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890959.883438:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996250368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.883468:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.883507:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788890959.883610:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996250368 00000100:00100000:0.0:1788890959.883615:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996250368 00000100:00100000:0.0:1788890959.883656:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788890959.883664:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996250368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788890959.883931:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996250368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.883939:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788890959.884123:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996250368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.884154:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996250496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.884226:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.884242:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788890959.884353:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996250496 00000100:00100000:0.0:1788890959.884358:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996250496 00000100:00100000:0.0:1788890959.884464:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788890959.884473:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996250496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788890959.884614:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996250496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890959.884621:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788890959.888820:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996250496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.889094:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11658:1875787996250624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890959.889190:0:11658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.889234:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996250624 00000100:00100000:1.0:1788890959.889241:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996250624 00000100:00100000:1.0:1788890959.889284:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788890959.889295:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:11658:x1875787996250624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890959.889564:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:11658:x1875787996250624:12345-0@lo:502:llog_process_th.0 Request processed in 269us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.889573:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788890959.889638:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788890959.889654:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11658:1875787996250624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890959.889680:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890959.889690:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890959.889692:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788890959.889702:0:11658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9da1f4e26000 00000020:00000080:1.0:1788890959.889704:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788890959.890209:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11658:1875787996250752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890959.890250:0:11658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.890274:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996250752 00000100:00100000:1.0:1788890959.890279:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996250752 00000100:00100000:1.0:1788890959.890305:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788890959.890312:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:11658:x1875787996250752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890959.890467:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:11658:x1875787996250752:12345-0@lo:502:llog_process_th.0 Request processed in 155us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.890474:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788890959.890505:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788890959.890520:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11658:1875787996250752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890959.890542:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890959.890548:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890959.890550:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788890959.890555:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788890959.890609:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788890959.890627:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890959.890637:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.890649:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788890959.890660:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788890959.890663:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1c9db0800 from 7 10000000:01000000:1.0:1788890959.890666:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788890959.890691:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.890700:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.890710:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890959.890724:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996250880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.890762:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.890776:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890959.890788:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996250880 00000100:00100000:1.0:1788890959.890792:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996250880 00000100:00100000:1.0:1788890959.890810:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788890959.890817:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:5812:x1875787996250880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890959.890825:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890959.890837:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3f08c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3f085 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.890872:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3f08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3f085 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.890882:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3f08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3f085 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.890892:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e400, rc 0) 00000100:00100000:1.0:1788890959.890923:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0148050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996250880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.890929:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788890959.890959:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996250880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788890959.890972:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.890981:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890959.891028:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996251008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.891062:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.891079:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788890959.891090:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996251008 00000100:00100000:1.0:1788890959.891093:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996251008 00000100:00100000:1.0:1788890959.891111:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788890959.891118:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996251008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.891354:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0149850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996251008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.891361:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788890959.891392:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996251008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.891420:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996251136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.891460:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.891475:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f4e3e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788890959.891486:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996251136 00000100:00100000:1.0:1788890959.891489:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996251136 00000100:00100000:1.0:1788890959.891507:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788890959.891513:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996251136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.894941:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f014b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:5812:x1875787996251136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3419us (3472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.894958:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788890959.895232:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68b804f9-71ae-42dc-a11e-677332e27dfa:5812:1875787996251136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788890959.895401:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11660:1875787996251264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890959.895448:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788890959.895469:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788890959.895472:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996251264 00000100:00100000:1.0:1788890959.895485:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996251264 00000100:00100000:1.0:1788890959.895516:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788890959.895525:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:11660:x1875787996251264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890959.895677:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:11660:x1875787996251264:12345-0@lo:502:llog_process_th.0 Request processed in 153us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.895683:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788890959.895715:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890959.895729:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11660:1875787996251264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890959.895751:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788890959.895759:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890959.895762:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788890959.895773:0:11660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9da1c9db0800 00000020:00000080:1.0:1788890959.895776:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788890959.895984:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11660:1875787996251392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890959.896022:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890959.896042:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996251392 00000100:00100000:1.0:1788890959.896046:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996251392 00000100:00100000:1.0:1788890959.896063:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788890959.896069:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:11660:x1875787996251392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788890959.896213:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:11660:x1875787996251392:12345-0@lo:502:llog_process_th.0 Request processed in 143us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890959.896221:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788890959.896249:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c36f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890959.896261:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68b804f9-71ae-42dc-a11e-677332e27dfa:11660:1875787996251392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788890959.896281:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788890959.896286:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788890959.896294:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788890959.896298:0:11660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788890959.896340:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788890959.896356:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788890959.896366:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.896378:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890959.932329:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996251520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890959.932405:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890959.932506:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996251520 00000100:00100000:3.0:1788890959.932513:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996251520 00000100:00100000:3.0:1788890959.932557:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788890959.932566:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996251520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890959.932604:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890959.932653:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996251520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890959.932661:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788890959.932703:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1c8bc9f80 x1875787996251520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890959.932722:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c8bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996251520:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788890959.972763:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 852e3539-1359-4cf9-b701-3f696e6c6e5e 00000020:00000080:1.0:1788890959.972772:0:6689:0:(genops.c:885:class_export_put()) final put ffff9da0c1182800/852e3539-1359-4cf9-b701-3f696e6c6e5e 00000020:00000080:3.0:1788890959.973224:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9da0c1182800/852e3539-1359-4cf9-b701-3f696e6c6e5e for lustre-OST0000 00000020:00000080:3.0:1788890959.973279:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da0c1182000 for lustre-OST0000 00000001:00080000:2.0:1788890959.980075:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788890959.980091:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1788890959.980123:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1788890959.980447:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890959.980646:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996251648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788890959.980715:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890959.980878:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996251648 00000100:00100000:3.0:1788890959.980886:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996251648 00000100:00100000:3.0:1788890959.980971:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788890959.980981:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996251648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788890959.981007:0:6662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788890959.981042:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa04f4b, atime: 0x6aa04f4b, ctime: 0x6aa04f4b, blocks: 0x1 00010000:00010000:3.0:1788890959.981051:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.981084:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=183s v=(0 0) 00010000:00010000:3.0:1788890959.981088:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890959.981094:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.981111:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.981122:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.981128:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890959.981237:0:6662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788890959.981697:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788890959.981704:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.981713:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788890959.981717:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.981725:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.981744:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.981751:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec3f093 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890959.981779:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890959.981781:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890959.981782:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890959.982034:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875787996251648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1053us (1318us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788890959.982043:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788890959.982419:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da201fa0000/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788890959.982427:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996251648:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788890959.990464:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788890960.887020:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788890961.014600:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788890961.015573:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 852e3539-1359-4cf9-b701-3f696e6c6e5e 00000020:00000080:0.0:1788890961.015584:0:7624:0:(genops.c:885:class_export_put()) final put ffff9da0c1180000/852e3539-1359-4cf9-b701-3f696e6c6e5e 00000020:00000080:3.0:1788890961.015677:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da0c1180000/852e3539-1359-4cf9-b701-3f696e6c6e5e for lustre-OST0001 00000020:00000080:3.0:1788890961.015740:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da0c1180800 for lustre-OST0001 00000100:00100000:3.0:1788890961.129875:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890961.129972:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890961.129979:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834112 00000100:00100000:0.0:1788890961.129994:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834112 00000100:00100000:1.0:1788890961.130048:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987833984 00000100:00080000:3.0:1788890961.130050:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890961.130060:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987833984 00000100:00100000:0.0:1788890961.130100:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:1.0:1788890961.130124:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 258 00000100:00100000:1.0:1788890961.130134:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987833984:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890961.130231:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987833984:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890961.130240:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 258 00000100:00100000:0.0:1788890961.130275:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2375:x1875787987834112:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890961.130349:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2375:x1875787987834112:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 85us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890961.130357:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:2.0:1788890961.131698:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890961.132680:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834240 00000100:00100000:1.0:1788890961.132691:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834240 00000100:00100000:1.0:1788890961.132888:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:1.0:1788890961.132898:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987834240:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890961.133019:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987834240:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 122us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890961.133027:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00080000:2.0:1788890961.133783:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890961.133839:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890961.134235:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834368 00000100:00100000:0.0:1788890961.134243:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834368 00000100:00100000:0.0:1788890961.134304:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 76 00000100:00100000:0.0:1788890961.134317:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2375:x1875787987834368:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890961.134380:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2375:x1875787987834368:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 65us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890961.134387:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 76 00000100:00080000:2.0:1788890961.134773:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788890962.038466:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890962.998511:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996251776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788890962.998589:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890962.998755:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996251776 00000100:00100000:3.0:1788890962.998776:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996251776 00000100:00100000:3.0:1788890962.998856:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788890962.998866:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875787996251776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890962.998909:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890962.998959:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875787996251776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890962.998966:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788890962.999008:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996251776:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788890962.999234:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788890963.063058:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890964.086592:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890964.534823:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996251904:0@lo:400:kworker.0 00000100:00100000:0.0:1788890964.534925:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890964.534996:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996252416:0@lo:400:kworker.0 00000100:00100000:0.0:1788890964.535026:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890964.535054:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890964.535061:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996252288:0@lo:400:kworker.0 00000100:00100000:0.0:1788890964.535090:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890964.535143:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996252288 00000100:00100000:0.0:1788890964.535153:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996252288 00000100:00100000:0.0:1788890964.535249:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788890964.535261:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996252288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890964.535324:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996252288:12345-0@lo:400:kworker.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890964.535332:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788890964.535384:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996252288:0@lo:400:kworker.0 00000100:00100000:3.0:1788890964.535527:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996251904 00000100:00100000:3.0:1788890964.535532:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996251904 00000100:00100000:3.0:1788890964.535573:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788890964.535582:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996251904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890964.535635:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996251904:12345-0@lo:400:kworker.0 Request processed in 54us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890964.535643:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788890964.535847:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996251904:0@lo:400:kworker.0 00000100:00100000:1.0:1788890964.536190:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996252032:0@lo:400:kworker.0 00000100:00100000:1.0:1788890964.536233:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890964.536260:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996252544:0@lo:400:kworker.0 00000100:00100000:3.0:1788890964.536280:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996252416 00000100:00100000:3.0:1788890964.536287:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996252416 00000100:00100000:1.0:1788890964.536288:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890964.536309:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890964.536317:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996252160:0@lo:400:kworker.0 00000100:00100000:3.0:1788890964.536329:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996252032 00000100:00100000:3.0:1788890964.536334:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996252032 00000100:00100000:1.0:1788890964.536358:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890964.536364:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788890964.536375:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996252416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890964.536392:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996252160 00000100:00100000:1.0:1788890964.536397:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996252160 00000100:00100000:3.0:1788890964.536423:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996252416:12345-0@lo:400:kworker.0 Request processed in 51us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890964.536426:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788890964.536440:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788890964.536441:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996252032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890964.536463:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788890964.536472:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996252160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890964.536483:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996252032:12345-0@lo:400:kworker.0 Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890964.536490:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788890964.536512:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996252160:12345-0@lo:400:kworker.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890964.536527:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788890964.536527:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996252160:0@lo:400:kworker.0 00000100:00100000:1.0:1788890964.536543:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996252032:0@lo:400:kworker.0 00000100:00100000:0.0:1788890964.536630:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996252544 00000100:00100000:0.0:1788890964.536634:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996252544 00000100:00100000:0.0:1788890964.536671:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788890964.536679:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996252544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890964.536721:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996252544:12345-0@lo:400:kworker.0 Request processed in 43us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890964.536727:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788890964.536776:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996252416:0@lo:400:kworker.0 00010000:00080000:1.0:1788890964.536853:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201c5aa00 x1875787996252544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788890964.536864:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996252544:0@lo:400:kworker.0 00000100:00080000:2.0:1788890964.537444:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890964.537451:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788890964.537454:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890965.048836:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996252672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788890965.048935:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890965.049026:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996252672 00000100:00100000:3.0:1788890965.049036:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996252672 00000100:00100000:3.0:1788890965.049091:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788890965.049102:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996252672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890965.049145:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890965.049216:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996252672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890965.049223:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788890965.049271:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201c59c00 x1875787996252672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890965.049295:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996252672:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788890965.070998:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1788890965.110337:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890966.135680:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890966.251112:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890966.251164:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890966.251253:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890966.251268:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834496 00000100:00100000:0.0:1788890966.251279:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834496 00000100:00100000:3.0:1788890966.251306:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834752 00000100:00100000:3.0:1788890966.251313:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834752 00000100:00100000:0.0:1788890966.251330:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 260 00000100:00100000:0.0:1788890966.251341:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987834496:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890966.251344:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890966.251369:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:3.0:1788890966.251381:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987834752:12345-192.168.204.18@tcp:400:kworker.0 00000100:00080000:2.0:1788890966.251391:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890966.251430:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987834496:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 92us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890966.251439:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987834752:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890966.251443:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 260 00000100:00100000:3.0:1788890966.251452:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:1.0:1788890966.251575:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834624 00000100:00100000:1.0:1788890966.251580:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834624 00000100:00100000:1.0:1788890966.251622:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987834880 00000100:00100000:1.0:1788890966.251626:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987834880 00000100:00100000:1.0:1788890966.251649:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 80 00000100:00100000:1.0:1788890966.251656:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2375:x1875787987834624:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890966.251691:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2375:x1875787987834624:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 36us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890966.251697:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 80 00000100:00100000:1.0:1788890966.251709:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 81 00000100:00100000:1.0:1788890966.251727:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2375:x1875787987834880:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890966.251763:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2375:x1875787987834880:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 48us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890966.251771:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 81 00000100:00080000:2.0:1788890966.251841:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788890967.158760:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890968.118744:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890968.118770:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996252800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890968.118842:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890968.119162:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996252800 00000100:00100000:1.0:1788890968.119194:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996252800 00000100:00100000:1.0:1788890968.119448:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788890968.119459:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996252800:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788890968.119481:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788890968.119504:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890968.119565:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996252800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890968.119572:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788890968.119773:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788890968.119780:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da201fa0000, transno 4294967300 00000100:00100000:0.0:1788890968.119842:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996252800:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788890968.182289:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890969.206609:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890969.656184:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890969.656295:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890969.656314:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996253312:0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.656383:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890969.656451:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996253312 00000100:00100000:0.0:1788890969.656458:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996253312 00000100:00100000:0.0:1788890969.656502:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788890969.656510:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996253312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.656557:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996253312:12345-0@lo:400:kworker.0 Request processed in 47us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890969.656564:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788890969.656600:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996253312:0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.656662:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996253184:0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.656689:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890969.656711:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788890969.656716:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996253056:0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.656737:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890969.656760:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996253184 00000100:00100000:0.0:1788890969.656763:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996253184 00000100:00100000:0.0:1788890969.656794:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996253056 00000100:00100000:0.0:1788890969.656796:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996253056 00000100:00100000:0.0:1788890969.656812:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788890969.656819:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996253184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.656861:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996253184:12345-0@lo:400:kworker.0 Request processed in 32us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890969.656867:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788890969.656879:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788890969.656884:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996253056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.656908:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996253056:12345-0@lo:400:kworker.0 Request processed in 24us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890969.656913:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788890969.656939:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996253056:0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.656953:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996253184:0@lo:400:kworker.0 00000100:00080000:0.0:1788890969.656978:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890969.657267:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996252928:0@lo:400:kworker.0 00000100:00100000:3.0:1788890969.657301:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890969.657377:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996252928 00000100:00100000:0.0:1788890969.657381:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996252928 00000100:00100000:0.0:1788890969.657410:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788890969.657416:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3279:x1875787996252928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.657543:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3279:x1875787996252928:12345-0@lo:400:kworker.0 Request processed in 127us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890969.657549:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788890969.657712:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996253440:0@lo:400:kworker.0 00000100:00100000:0.0:1788890969.657739:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890969.657803:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996253568:0@lo:400:kworker.0 00000100:00100000:2.0:1788890969.657832:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890969.657868:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996253568 00000100:00100000:2.0:1788890969.657872:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996253568 00000100:00100000:2.0:1788890969.657903:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788890969.657910:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996253568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890969.657942:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996253568:12345-0@lo:400:kworker.0 Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890969.657948:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788890969.657985:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1fbb29f80 x1875787996253568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890969.657997:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996253568:0@lo:400:kworker.0 00000100:00080000:2.0:1788890969.658012:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788890969.658197:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996253440 00000100:00100000:3.0:1788890969.658202:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996253440 00000100:00100000:3.0:1788890969.658239:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788890969.658246:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996253440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788890969.658316:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996252928:0@lo:400:kworker.0 00000100:00080000:2.0:1788890969.658385:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890969.658449:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996253440:12345-0@lo:400:kworker.0 Request processed in 202us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890969.658456:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788890969.658501:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996253440:0@lo:400:kworker.0 00000040:00080000:3.0:1788890970.102887:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788890970.166401:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788890970.166435:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996253696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788890970.166532:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890970.166659:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996253696 00000100:00100000:3.0:1788890970.166668:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996253696 00000100:00100000:3.0:1788890970.166721:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788890970.166731:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996253696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890970.166767:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890970.166822:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996253696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890970.166830:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788890970.166867:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201c5b100 x1875787996253696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890970.166886:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996253696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788890970.230480:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890971.254684:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890971.373103:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890971.373207:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890971.373253:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890971.373289:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890971.373426:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835008 00000100:00100000:2.0:1788890971.373434:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835264 00000100:00100000:0.0:1788890971.373440:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835008 00000100:00100000:2.0:1788890971.373451:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835264 00000100:00100000:0.0:1788890971.373516:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 262 00000100:00100000:0.0:1788890971.373532:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987835008:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890971.373557:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 54 00000100:00100000:2.0:1788890971.373571:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987835264:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890971.373651:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987835008:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 123us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890971.373661:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 262 00000100:00100000:2.0:1788890971.373669:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987835264:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 98us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890971.373679:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 54 00000100:00100000:0.0:1788890971.373722:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835136 00000100:00100000:0.0:1788890971.373729:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835136 00000100:00100000:0.0:1788890971.373767:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835392 00000100:00100000:0.0:1788890971.373771:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835392 00000100:00100000:0.0:1788890971.373805:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 85 00000100:00100000:0.0:1788890971.373815:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987835136:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890971.373859:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987835136:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 46us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890971.373867:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 85 00000100:00100000:0.0:1788890971.373880:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 86 00000100:00100000:0.0:1788890971.373886:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987835392:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890971.373936:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987835392:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 50us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890971.373943:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 86 00000100:00080000:1.0:1788890971.374029:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788890971.374035:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788890972.278833:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890973.239155:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890973.239198:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996253824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890973.239273:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890973.239421:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996253824 00000100:00100000:3.0:1788890973.239430:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996253824 00000100:00100000:3.0:1788890973.239513:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788890973.239525:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996253824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890973.239571:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890973.239639:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996253824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (365us total) trans 0 rc 0/0 00000100:00080000:2.0:1788890973.239640:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890973.239650:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788890973.239703:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996253824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788890973.302437:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890974.326416:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890974.775961:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788890974.776287:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996254080:0@lo:400:kworker.0 00000100:00100000:0.0:1788890974.776390:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890974.776567:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996253952:0@lo:400:kworker.0 00000100:00100000:1.0:1788890974.776607:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890974.776686:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996253952 00000100:00100000:0.0:1788890974.776695:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996253952 00000100:00100000:2.0:1788890974.776750:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996254080 00000100:00100000:0.0:1788890974.776751:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788890974.776757:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996254080 00000100:00100000:0.0:1788890974.776765:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3279:x1875787996253952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890974.776809:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788890974.776819:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996254080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890974.776830:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3279:x1875787996253952:12345-0@lo:400:kworker.0 Request processed in 67us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890974.776838:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788890974.776872:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996254080:12345-0@lo:400:kworker.0 Request processed in 55us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890974.776880:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788890974.776898:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996254080:0@lo:400:kworker.0 00000100:00100000:1.0:1788890974.776985:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996253952:0@lo:400:kworker.0 00000100:00100000:0.0:1788890974.777476:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996254208:0@lo:400:kworker.0 00000100:00100000:0.0:1788890974.777508:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890974.777586:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996254208 00000100:00100000:1.0:1788890974.777607:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996254208 00000100:00100000:1.0:1788890974.777662:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788890974.777667:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890974.777673:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996254208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890974.778185:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996254464:0@lo:400:kworker.0 00000100:00100000:2.0:1788890974.778220:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890974.778247:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788890974.778253:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996254336:0@lo:400:kworker.0 00000100:00100000:2.0:1788890974.778280:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890974.778308:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996254336 00000100:00100000:2.0:1788890974.778312:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996254336 00000100:00100000:2.0:1788890974.778343:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788890974.778351:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996254336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890974.778400:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996254336:12345-0@lo:400:kworker.0 Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890974.778407:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788890974.778442:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996254336:0@lo:400:kworker.0 00000100:00100000:2.0:1788890974.778460:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996254592:0@lo:400:kworker.0 00000100:00100000:2.0:1788890974.778479:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890974.778503:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996254592 00000100:00100000:2.0:1788890974.778507:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996254592 00000100:00100000:2.0:1788890974.778529:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788890974.778535:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996254592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890974.778580:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996254592:12345-0@lo:400:kworker.0 Request processed in 45us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890974.778586:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788890974.778598:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788890974.778616:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201c5b480 x1875787996254592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788890974.778637:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996254592:0@lo:400:kworker.0 00000100:00100000:2.0:1788890974.778671:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996254464 00000100:00100000:2.0:1788890974.778674:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996254464 00000100:00100000:2.0:1788890974.778705:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788890974.778712:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996254464:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788890974.778818:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890974.779044:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996254464:12345-0@lo:400:kworker.0 Request processed in 332us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890974.779052:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788890974.779104:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996254464:0@lo:400:kworker.0 00000100:00100000:1.0:1788890974.779144:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996254208:12345-0@lo:400:kworker.0 Request processed in 1472us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890974.779146:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996254208:0@lo:400:kworker.0 00000100:00100000:1.0:1788890974.779160:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788890975.286642:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890975.286669:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996254720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890975.286757:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890975.286837:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996254720 00000100:00100000:3.0:1788890975.286856:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996254720 00000100:00100000:3.0:1788890975.286913:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788890975.286923:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996254720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890975.286951:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890975.286995:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996254720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890975.287000:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788890975.287196:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201c59f80 x1875787996254720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890975.287219:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996254720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890975.350486:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890976.375271:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890976.491783:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890976.491840:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890976.491864:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835520 00000100:00100000:0.0:1788890976.491876:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835520 00000100:00100000:0.0:1788890976.491935:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 264 00000100:00100000:0.0:1788890976.491945:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987835520:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890976.492020:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987835520:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890976.492028:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 264 00000100:00100000:2.0:1788890976.492263:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835648 00000100:00100000:2.0:1788890976.492269:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835648 00000100:00100000:2.0:1788890976.492376:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 90 00000100:00100000:2.0:1788890976.492387:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987835648:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890976.492440:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987835648:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 55us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890976.492448:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 90 00000100:00080000:3.0:1788890976.492497:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890976.500498:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890976.500599:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890976.501270:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835904 00000100:00100000:0.0:1788890976.501280:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835904 00000100:00100000:0.0:1788890976.501396:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 91 00000100:00100000:0.0:1788890976.501406:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2373:x1875787987835904:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890976.501477:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2373:x1875787987835904:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 73us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890976.501483:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 91 00000100:00100000:2.0:1788890976.501751:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987835776 00000100:00100000:2.0:1788890976.501763:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987835776 00000100:00080000:3.0:1788890976.502214:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788890976.502219:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890976.502847:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:2.0:1788890976.502913:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2371:x1875787987835776:12345-192.168.204.18@tcp:9:kworker.0 00000020:00000080:2.0:1788890976.502939:0:6663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3efcf 00000100:00080000:2.0:1788890976.502950:0:6663:0:(import.c:65:import_set_state_nolock()) ffff9da1ffeb9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788890976.503002:0:6663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1788890976.503016:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890976.503308:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+2:2371:x1875787987835776:12345-192.168.204.18@tcp:9:kworker.0 Request processed in 401us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890976.503316:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 19 00010000:00010000:0.0:1788890977.399788:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890978.359516:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996254848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788890978.359725:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890978.359942:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996254848 00000100:00100000:3.0:1788890978.359952:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996254848 00000100:00080000:2.0:1788890978.359994:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890978.360025:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788890978.360036:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996254848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890978.360076:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890978.360138:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996254848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890978.360145:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788890978.360581:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996254848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788890978.424296:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890979.448016:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890979.894591:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996255232:0@lo:400:kworker.0 00000100:00100000:0.0:1788890979.894670:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890979.894727:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788890979.894732:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996255104:0@lo:400:kworker.0 00000100:00100000:0.0:1788890979.894751:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890979.894765:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996255616:0@lo:400:kworker.0 00000100:00100000:0.0:1788890979.894784:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890979.894811:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996255232 00000100:00100000:0.0:1788890979.894818:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996255232 00000100:00100000:0.0:1788890979.894861:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996255104 00000100:00100000:0.0:1788890979.894863:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996255104 00000100:00100000:0.0:1788890979.894882:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788890979.894901:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996255232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890979.894945:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996255232:12345-0@lo:400:kworker.0 Request processed in 45us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890979.894952:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788890979.894968:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788890979.894973:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996255104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890979.894992:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996255104:12345-0@lo:400:kworker.0 Request processed in 20us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890979.894998:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788890979.895028:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996255104:0@lo:400:kworker.0 00000100:00100000:0.0:1788890979.895037:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996255232:0@lo:400:kworker.0 00000100:00100000:3.0:1788890979.895148:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996254976:0@lo:400:kworker.0 00000100:00100000:3.0:1788890979.895196:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890979.895224:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996255488:0@lo:400:kworker.0 00000100:00100000:3.0:1788890979.895243:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890979.895258:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788890979.895269:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996255360:0@lo:400:kworker.0 00000100:00100000:3.0:1788890979.895287:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890979.895307:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996255488 00000100:00100000:3.0:1788890979.895310:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996255488 00000100:00100000:3.0:1788890979.895333:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788890979.895339:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996255488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890979.895367:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996255488:12345-0@lo:400:kworker.0 Request processed in 29us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890979.895373:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788890979.895388:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996255616 00000100:00100000:3.0:1788890979.895390:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996255616 00000100:00100000:3.0:1788890979.895408:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996255360 00000100:00100000:3.0:1788890979.895409:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996255360 00000100:00100000:3.0:1788890979.895421:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788890979.895427:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996255616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890979.895465:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996255616:12345-0@lo:400:kworker.0 Request processed in 38us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890979.895471:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788890979.895481:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788890979.895486:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996255360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890979.895508:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996255360:12345-0@lo:400:kworker.0 Request processed in 23us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890979.895514:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788890979.895537:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996255360:0@lo:400:kworker.0 00000100:00100000:3.0:1788890979.895546:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996255488:0@lo:400:kworker.0 00000100:00100000:0.0:1788890979.895662:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996254976 00000100:00100000:0.0:1788890979.895666:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996254976 00000100:00100000:0.0:1788890979.895697:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788890979.895703:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996254976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890979.895738:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996254976:12345-0@lo:400:kworker.0 Request processed in 36us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890979.895744:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00080000:0.0:1788890979.895774:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f6f480 x1875787996255616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788890995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890979.895784:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996255616:0@lo:400:kworker.0 00000100:00100000:3.0:1788890979.895877:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996254976:0@lo:400:kworker.0 00000100:00080000:2.0:1788890979.896056:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788890979.896060:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788890980.343789:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788890980.406907:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996255744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890980.407018:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890980.408905:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996255744 00000100:00100000:0.0:1788890980.408918:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996255744 00000100:00100000:0.0:1788890980.408968:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788890980.408979:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996255744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788890980.409086:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788890980.409165:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996255744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890980.409347:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788890980.409535:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201c58a80 x1875787996255744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788890996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788890980.409559:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996255744:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788890980.467290:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:1.0:1788890980.467301:0:6689:0:(genops.c:885:class_export_put()) final put ffff9da1f4c1a000/671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:0.0:1788890980.467345:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f4c1a000/671ae218-3c0c-4db9-9d11-9d6b732a0de5 for lustre-OST0000 00000020:00000080:0.0:1788890980.467406:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1ffeb9000 for lustre-OST0000 00010000:00010000:2.0:1788890980.470609:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788890980.645140:0:11835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:09:40 (1788890980) 00010000:00010000:1.0:1788890981.494341:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890981.610036:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890981.610135:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890981.610206:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890981.611331:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836288 00000100:00100000:2.0:1788890981.611345:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836288 00000100:00100000:2.0:1788890981.611428:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836160 00000100:00100000:2.0:1788890981.611446:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836160 00000100:00100000:2.0:1788890981.611477:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 95 00000100:00100000:2.0:1788890981.611487:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987836288:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890981.611572:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2372:x1875787987836288:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 86us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890981.611579:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 95 00000100:00100000:2.0:1788890981.611595:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 96 00000100:00100000:2.0:1788890981.611602:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987836160:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890981.611626:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2372:x1875787987836160:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 25us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890981.611632:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 96 00000100:00080000:3.0:1788890981.611704:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890981.613808:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836032 00000100:00100000:0.0:1788890981.613821:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836032 00000100:00100000:0.0:1788890981.613888:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 266 00000100:00100000:0.0:1788890981.613899:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2372:x1875787987836032:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890981.613981:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2372:x1875787987836032:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 83us (3955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890981.613989:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 266 00000100:00100000:3.0:1788890981.626303:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890981.626471:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836416 00000100:00100000:2.0:1788890981.626482:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836416 00000100:00100000:2.0:1788890981.626548:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 32 00000100:00100000:2.0:1788890981.626560:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:10247:x1875787987836416:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788890981.626581:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890981.626607:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f09a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ca0 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.626683:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f0a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.626697:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.626711:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890981.626875:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788890981.626879:0:6852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890981.626918:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.626941:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f09a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ca0 expref: 7 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.626959:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ca0 expref: 6 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.626968:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890981.626971:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890981.626974:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86400, rc 0) 00000100:00100000:2.0:1788890981.627036:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:10247:x1875787987836416:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 479us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890981.627042:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 32 00000100:00100000:2.0:1788890981.634133:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890981.634276:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836544 00000100:00100000:1.0:1788890981.634290:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836544 00000100:00100000:1.0:1788890981.634363:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:1.0:1788890981.634373:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:10248:x1875787987836544:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788890981.634395:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890981.634427:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f0a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ca7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634497:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634512:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634538:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634557:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634565:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634572:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634786:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f0bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634795:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f0bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634803:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f0bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890981.634830:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788890981.634834:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788890981.634855:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f0bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634866:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634871:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634886:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634892:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890981.634896:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634903:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634915:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:1.0:1788890981.634918:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890981.634922:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634929:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f0af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634942:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634949:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634955:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634961:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890981.634964:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634980:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.634989:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9da1c32fc700) 00010000:00010000:1.0:1788890981.634991:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890981.634994:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.635001:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f0b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.635031:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f0a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ca7 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.635044:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f0bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ca7 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890981.635050:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9da1c32fc000) 00010000:00010000:1.0:1788890981.635052:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788890981.635054:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6fa00, rc 0) 00000100:00100000:1.0:1788890981.635126:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:10248:x1875787987836544:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 755us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890981.635134:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:1.0:1788890981.641079:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890981.641213:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836800 00000100:00100000:2.0:1788890981.641223:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836800 00000100:00100000:2.0:1788890981.641291:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00100000:2.0:1788890981.641301:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:10248:x1875787987836800:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788890981.641328:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890981.641350:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f0c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cae expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.641436:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.641459:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.641471:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.641535:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.641544:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.641555:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.641881:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3f0d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.641890:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3f0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.641897:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3f0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890981.641908:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788890981.642062:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642070:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642077:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642090:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890981.642094:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642101:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642113:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9da1c32fc000) 00010000:00010000:2.0:1788890981.642116:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890981.642121:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642126:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f0cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642138:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642144:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642150:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642155:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890981.642158:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642163:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642229:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9da1c2aee400) 00010000:00010000:2.0:1788890981.642231:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890981.642235:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642240:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f0d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642695:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f0c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cae expref: 10 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642712:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3f0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cae expref: 9 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890981.642720:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:2.0:1788890981.642723:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890981.642725:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87000, rc 0) 00000100:00100000:2.0:1788890981.643006:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:10248:x1875787987836800:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 1705us (1935us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788890981.643014:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00100000:3.0:1788890981.645842:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890981.645932:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987836928 00000100:00100000:2.0:1788890981.645942:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987836928 00000100:00100000:2.0:1788890981.646010:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 35 00000100:00100000:2.0:1788890981.646023:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:10248:x1875787987836928:12345-192.168.204.18@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788890981.646229:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:10248:x1875787987836928:12345-192.168.204.18@tcp:59:lhsmtool_posix.0 Request processed in 208us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890981.646238:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 35 00000040:00080000:0.0:1788890982.390835:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788890982.519464:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890982.841071:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890982.841204:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837056 00000100:00100000:2.0:1788890982.841214:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837056 00000100:00100000:2.0:1788890982.841302:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 36 00000100:00100000:2.0:1788890982.841313:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:10290:x1875787987837056:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890982.841336:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890982.841359:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cb5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841431:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841446:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841457:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841472:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841479:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841485:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841704:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841711:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841725:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841731:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890982.841734:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841741:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841753:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890982.841756:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890982.841760:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841766:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f0ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841778:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841784:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841789:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841794:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890982.841796:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841812:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841821:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890982.841823:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890982.841826:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841831:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f0f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841864:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cb5 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841875:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890982.841877:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890982.841881:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cb5 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.841890:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87600, rc 0) 00000100:00100000:2.0:1788890982.841956:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:10290:x1875787987837056:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 645us (891us total) trans 0 rc 301/301 00000100:00100000:2.0:1788890982.841963:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 36 00000100:00100000:3.0:1788890982.846704:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890982.846822:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837312 00000100:00100000:2.0:1788890982.846832:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837312 00000100:00100000:2.0:1788890982.846887:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:2.0:1788890982.846900:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:10290:x1875787987837312:12345-192.168.204.18@tcp:36:lfs.0 00010000:00010000:2.0:1788890982.846964:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890982.846993:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f0a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ca0 expref: 9 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.847011:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890982.847022:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890982.847226:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.847236:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.847243:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.847250:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.847254:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.847258:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890982.848101:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788890982.848112:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.848120:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.848128:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.848140:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890982.848144:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.848152:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.848162:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890982.848165:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890982.848188:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.848194:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f0fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890982.848210:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c08dfa4c reply state 000000005e3fec39 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890982.848218:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788890982.848326:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:10290:x1875787987837312:12345-192.168.204.18@tcp:36:lfs.0 Request processed in 1428us (1630us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788890982.848334:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 37 00010000:00010000:3.0:1788890982.853152:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.853184:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.853194:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.853201:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890982.853206:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.853214:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.853235:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9da1c2aeef00) 00010000:00010000:3.0:1788890982.853238:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890982.853243:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.853250:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f103 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890982.903704:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890982.903807:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837440 00000100:00100000:1.0:1788890982.903817:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837440 00000100:00100000:1.0:1788890982.903882:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 38 00000100:00100000:1.0:1788890982.903893:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:10298:x1875787987837440:12345-192.168.204.18@tcp:101:lctl.0 00010000:00010000:1.0:1788890982.903931:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890982.903953:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f10a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cbc expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890982.904014:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3f111 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890982.904027:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3f111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890982.904038:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3f111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890982.904072:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788890982.904075:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788890982.904110:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3f111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890982.904134:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f10a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cbc expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890982.905358:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3f111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cbc expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890982.905368:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:1.0:1788890982.905371:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788890982.905375:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e600, rc 0) 00000100:00100000:1.0:1788890982.905447:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:10298:x1875787987837440:12345-192.168.204.18@tcp:101:lctl.0 Request processed in 1556us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890982.905455:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 38 00000100:00100000:1.0:1788890982.946032:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890982.946143:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837568 00000100:00100000:2.0:1788890982.946153:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837568 00000100:00100000:2.0:1788890982.946274:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:2.0:1788890982.946284:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:10304:x1875787987837568:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890982.946309:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890982.946330:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cc3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946440:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946454:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946466:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946480:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946488:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946494:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946590:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3f12d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946598:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3f12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946681:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3f12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890982.946710:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788890982.946714:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890982.946751:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3f12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946774:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946780:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946787:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946793:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890982.946798:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946805:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946817:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:2.0:1788890982.946820:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890982.946825:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946831:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f11f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946843:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946849:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946854:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946865:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890982.946868:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946874:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946883:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890982.946885:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890982.946888:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946893:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f126 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946924:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cc3 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946937:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3f12d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cc3 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.946945:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890982.946947:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788890982.946949:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86800, rc 0) 00000100:00100000:2.0:1788890982.947010:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:10304:x1875787987837568:12345-192.168.204.18@tcp:101:bash.0 Request processed in 727us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890982.947016:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:0.0:1788890982.950333:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890982.950496:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837824 00000100:00100000:2.0:1788890982.950516:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837824 00000100:00100000:2.0:1788890982.950574:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 40 00000100:00100000:2.0:1788890982.950583:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:10304:x1875787987837824:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890982.950600:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890982.950618:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f134 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cca expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.950738:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.950753:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.950764:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.950826:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.950835:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.950841:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788890982.952039:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788890982.953653:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953672:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953699:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953739:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953747:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953754:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953760:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890982.953764:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953771:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953784:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890982.953787:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890982.953791:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953798:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f13b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890982.953811:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bf75432 reply state 00000000c9b428c3 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890982.953819:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788890982.953863:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f134 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cca expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953877:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cca expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.953885:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890982.953887:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890982.953890:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87600, rc 0) 00000100:00100000:2.0:1788890982.953967:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:10304:x1875787987837824:12345-192.168.204.18@tcp:101:bash.0 Request processed in 3384us (3640us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788890982.953976:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 40 00010000:00010000:0.0:1788890982.955794:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890982.955808:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890982.955826:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890982.955831:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890982.955835:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890982.955842:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890982.955855:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aee900) 00010000:00010000:0.0:1788890982.955858:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890982.955862:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890982.955867:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f142 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890982.957377:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890982.957454:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987837952 00000100:00100000:3.0:1788890982.957465:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987837952 00000100:00100000:3.0:1788890982.957509:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 20 00000100:00100000:3.0:1788890982.957517:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875787987837952:12345-192.168.204.18@tcp:8:bash.0 00010000:00080000:3.0:1788890982.957559:0:6664:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:3.0:1788890982.957587:0:6664:0:(genops.c:1385:class_connect()) connect: client 671ae218-3c0c-4db9-9d11-9d6b732a0de5, cookie 0x9161b78f8ec3f157 00002000:00100000:3.0:1788890982.957598:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 671ae218-3c0c-4db9-9d11-9d6b732a0de5/ffff9da0c1180000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788890982.957619:0:6664:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788890982.957847:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788890982.957876:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9da0c1182000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788890982.957949:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2371:x1875787987837952:12345-192.168.204.18@tcp:8:bash.0 Request processed in 431us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890982.957957:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 20 00000100:00100000:1.0:1788890982.959946:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890982.960158:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838080 00000100:00100000:2.0:1788890982.960182:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838080 00000100:00080000:3.0:1788890982.960246:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788890982.960252:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:2.0:1788890982.960263:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:0:x1875787987838080:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890982.960279:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890982.960301:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cd1 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788890982.960329:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788890982.960346:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=206s v=(0 0) 00010000:00010000:2.0:1788890982.960351:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890982.960360:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd1 expref: 7 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.960380:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd1 expref: 7 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.960424:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87800, rc 0) 00000100:00100000:2.0:1788890982.960473:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:0:x1875787987838080:12345-192.168.204.18@tcp:101:bash.0 Request processed in 212us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890982.960481:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:1.0:1788890982.967232:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890982.967300:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838208 00000100:00100000:3.0:1788890982.967311:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838208 00000100:00100000:3.0:1788890982.967372:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 22 00000100:00100000:3.0:1788890982.967382:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:10304:x1875787987838208:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:3.0:1788890982.967412:0:6664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890982.967433:0:6664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cd8 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.967466:0:6664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd1 expref: 8 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.967500:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890982.967504:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890982.967511:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 8 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.967545:0:6664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd1 expref: 8 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.967559:0:6664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd1 expref: 8 pid: 6663 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890982.967574:0:6664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6664:1875787996255872:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890982.967675:0:6664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890982.970910:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890982.970999:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838336 00000100:00100000:2.0:1788890982.971009:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838336 00010000:00010000:2.0:1788890982.971049:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd1 expref: 9 pid: 6663 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890982.971092:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00100000:2.0:1788890982.971101:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5337480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2374:x1875787987838336:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890982.971116:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890982.971140:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd1 expref: 9 pid: 6663 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.971153:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd1 expref: 9 pid: 6663 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.971210:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890982.971216:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890982.971225:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 9 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.971236:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 9 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890982.971285:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 9 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890982.971300:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5800:1875787996256000:192.168.204.18@tcp:105: 00000100:00100000:2.0:1788890982.971377:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92c6300 going to sleep for 11 seconds 00010000:00010000:3.0:1788890982.971652:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3f15e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd1 expref: 9 pid: 6663 timeout: 306 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890982.971669:0:6664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6664:1875787996255872:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890982.971698:0:6664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 8 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890982.971708:0:6664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc400, rc 0) 00000100:00100000:3.0:1788890982.971738:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:10304:x1875787987838208:12345-192.168.204.18@tcp:101:bash.0 Request processed in 4358us (4517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890982.971754:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 22 00000100:00100000:3.0:1788890982.973431:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5800:1875787996256000:192.168.204.18@tcp:105: 00010000:00010000:3.0:1788890982.973455:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890982.973502:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5337480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987838336:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 2402us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890982.973512:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00100000:0.0:1788890982.975530:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890982.975637:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838592 00000100:00100000:1.0:1788890982.975646:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838592 00000100:00100000:1.0:1788890982.975730:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:1.0:1788890982.975741:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:10304:x1875787987838592:12345-192.168.204.18@tcp:35:bash.0 00000100:00100000:1.0:1788890982.976132:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:10304:x1875787987838592:12345-192.168.204.18@tcp:35:bash.0 Request processed in 392us (614us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788890982.976140:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:1.0:1788890983.030900:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890983.031243:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987838848 00000100:00100000:0.0:1788890983.031254:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987838848 00000100:00100000:0.0:1788890983.031407:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00100000:0.0:1788890983.031418:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:10314:x1875787987838848:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890983.031445:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890983.031470:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3f16c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cdf expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890983.031566:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788890983.031708:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3f16c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cdf expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.031724:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:0.0:1788890983.031727:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788890983.031731:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031600/0x9161b78f8ec3f16c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cdf expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.031744:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031600, rc 0) 00000100:00100000:0.0:1788890983.031806:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:10314:x1875787987838848:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 392us (917us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788890983.031813:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00080000:3.0:1788890983.032046:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890983.040745:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.042407:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839104 00000100:00100000:2.0:1788890983.042421:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839104 00000100:00100000:2.0:1788890983.042494:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:2.0:1788890983.042505:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:10314:x1875787987839104:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788890983.042771:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:10314:x1875787987839104:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 267us (2038us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788890983.042779:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:1.0:1788890983.097745:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890983.097926:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839232 00000100:00100000:3.0:1788890983.097937:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839232 00000100:00100000:3.0:1788890983.098007:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 42 00000100:00100000:3.0:1788890983.098018:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:10320:x1875787987839232:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788890983.098045:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890983.098068:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3f17a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ce6 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.098617:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f181 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.098632:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.098643:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.098677:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788890983.098681:0:6852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890983.098700:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.098727:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3f17a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ce6 expref: 18 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.098760:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ce6 expref: 17 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.098769:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890983.098772:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890983.098775:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86000, rc 0) 00000100:00100000:2.0:1788890983.099539:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:10320:x1875787987839232:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 1520us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.099546:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 42 00000100:00100000:0.0:1788890983.102984:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.103230:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839488 00000100:00100000:2.0:1788890983.103242:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839488 00000100:00100000:2.0:1788890983.103312:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:2.0:1788890983.103324:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:10320:x1875787987839488:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890983.103347:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890983.103372:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ced expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.103491:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f18f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.103507:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f18f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.103519:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f18f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.103531:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788890983.103671:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ced expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.103690:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f18f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ced expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.103699:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890983.103702:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890983.103706:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86400, rc 0) 00000100:00100000:2.0:1788890983.103775:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:10320:x1875787987839488:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 453us (803us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788890983.103783:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:3.0:1788890983.108250:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.108289:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839744 00000100:00100000:2.0:1788890983.108301:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839744 00000100:00100000:2.0:1788890983.108426:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 44 00000100:00100000:2.0:1788890983.108438:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:10320:x1875787987839744:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890983.108466:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890983.108490:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f19d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cf4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.108613:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.108628:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.108641:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.108665:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788890983.108779:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f19d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cf4 expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.108799:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cf4 expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.108808:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890983.108811:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788890983.108814:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87800, rc 0) 00000100:00100000:2.0:1788890983.108899:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:10320:x1875787987839744:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 463us (660us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788890983.108906:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 44 00000100:00100000:3.0:1788890983.108980:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890983.109020:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987839872 00000100:00100000:3.0:1788890983.109024:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987839872 00000100:00100000:3.0:1788890983.109059:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:3.0:1788890983.109068:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:2374:x1875787987839872:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890983.109078:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890983.109095:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3f18f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ced expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.109120:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:3.0:1788890983.109124:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890983.109159:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:2374:x1875787987839872:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890983.109188:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:0.0:1788890983.116527:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.116619:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840000 00000100:00100000:2.0:1788890983.116631:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840000 00000100:00100000:2.0:1788890983.116698:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:2.0:1788890983.116709:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2372:x1875787987840000:12345-192.168.204.18@tcp:1:lfs.0 00010000:00010000:2.0:1788890983.116758:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.116783:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.116792:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890983.116797:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890983.116802:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.117027:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.117043:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 7 pid: 6664 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.117061:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6662:1875787996256128:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890983.117276:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92c6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.121542:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890983.121793:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840128 00000100:00100000:3.0:1788890983.121804:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840128 00000100:00100000:2.0:1788890983.122003:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6662:1875787996256128:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890983.122039:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1788890983.122348:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9da1c3289500 x1875787987840128/t0(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:34/0 lens 504/0 e 0 to 0 dl 1788890994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788890983.122356:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1c3289500 with x1875787987840128 ext(0->12) 00010000:00010000:3.0:1788890983.122362:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 8 pid: 6664 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.122374:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 8 pid: 6664 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890983.122379:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9da1c3289500 00000100:00100000:3.0:1788890983.122423:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:3.0:1788890983.122435:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987840128:12345-192.168.204.18@tcp:4:lfs.0 00000001:00100000:2.0:1788890983.160974:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000100:00100000:3.0:1788890983.166400:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987840128:12345-192.168.204.18@tcp:4:lfs.0 Request processed in 43945us (44848us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788890983.166417:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 0 00002000:00100000:3.0:1788890983.166433:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9da1c3289500 x1875787987840128/t4294967299(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:34/0 lens 504/448 e 0 to 0 dl 1788890994 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788890983.166458:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1c3289500 with x1875787987840128 ext(0->12) 00010000:00010000:3.0:1788890983.166470:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 9 pid: 6664 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.166489:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 9 pid: 6664 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890983.166497:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9da1c3289500 00000100:00100000:3.0:1788890983.169874:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.169995:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840256 00000100:00100000:1.0:1788890983.170005:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840256 00010000:00010000:1.0:1788890983.170054:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 9 pid: 6664 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.170102:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 35 00000100:00100000:1.0:1788890983.170113:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2374:x1875787987840256:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890983.170129:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788890983.170150:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788890983.170153:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788890983 00002000:00010000:1.0:1788890983.170155:0:5799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788890983 00002000:00010000:1.0:1788890983.170157:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788890983 00010000:00010000:1.0:1788890983.170164:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 9 pid: 6664 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.170234:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 9 pid: 6664 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.170261:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f165 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cd8 expref: 9 pid: 6664 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.170280:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1788890983.170284:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788890983.170290:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.170301:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.170327:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890983.170396:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2374:x1875787987840256:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 284us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.170404:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 35 00010000:00010000:2.0:1788890983.171476:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.171495:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.171537:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.171544:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.171571:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.171576:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890983.171579:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.171585:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.171605:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.171611:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f1b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.171833:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2372:x1875787987840000:12345-192.168.204.18@tcp:1:lfs.0 Request processed in 55119us (55312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.171844:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:3.0:1788890983.174356:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.174437:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840512 00000100:00100000:2.0:1788890983.174454:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840512 00000100:00100000:2.0:1788890983.174592:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:2.0:1788890983.174606:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:10320:x1875787987840512:12345-192.168.204.18@tcp:35:lfs.0 00000004:00010000:2.0:1788890983.174695:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cf4 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890983.175124:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788890983.175234:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788890983.175924:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788890983.175997:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.176017:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cca expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.176028:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.176076:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cca expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.176096:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cca expref: 24 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.176116:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1875787996256256:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890983.176281:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8564e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.178793:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.178913:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1875787996256256:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890983.178950:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.179020:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840640 00000100:00100000:1.0:1788890983.179031:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840640 00010000:00010000:1.0:1788890983.179079:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cca expref: 25 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.179238:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 36 00000100:00100000:1.0:1788890983.179252:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:2374:x1875787987840640:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890983.179302:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890983.179313:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cca expref: 25 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.179328:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cca expref: 25 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.179360:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cca expref: 25 pid: 5816 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.179390:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:1.0:1788890983.179396:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.179408:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.179417:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.179445:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890983.179522:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:2374:x1875787987840640:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 273us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.179530:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 36 00010000:00010000:2.0:1788890983.179603:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.179611:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890983.179795:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788890983.180024:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788890983.180156:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875787996256384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788890983.180251:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890983.180284:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c85643c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.180886:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996256384 00000100:00100000:0.0:1788890983.180897:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996256384 00000100:00100000:0.0:1788890983.180977:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788890983.180997:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1875787996256384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788890983.181128:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1875787996256384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 142us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890983.181136:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788890983.181275:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875787996256384:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788890983.182038:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788890983.182320:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788890983.182433:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875787996256512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788890983.182510:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890983.182544:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5ade540 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.182588:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996256512 00000100:00100000:0.0:1788890983.182595:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996256512 00000100:00100000:0.0:1788890983.182648:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788890983.182658:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1875787996256512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788890983.182948:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1875787996256512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 291us (436us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788890983.182958:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788890983.182992:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875787996256512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788890983.183102:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788890983.183142:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.183155:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.183163:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.184441:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890983.184448:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.184458:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.184500:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890983.184503:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788890983.184508:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.184515:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788890983.184795:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788890983.185218:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788890983.185236:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 207034066372ns, next at 208034063000ns, rc = 0 00000001:00080000:2.0:1788890983.185248:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788890983.185543:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890983.185547:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788890983.185557:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cf4 expref: 28 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.185700:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:10320:x1875787987840512:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 11095us (11353us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788890983.185712:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 8 00000020:00080000:2.0:1788890983.185719:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788890983.190370:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.190610:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987840768 00000100:00100000:2.0:1788890983.190621:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987840768 00000100:00100000:2.0:1788890983.190694:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:2.0:1788890983.190706:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:10320:x1875787987840768:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890983.190732:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890983.190879:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f1c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1cfb expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.190971:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f1c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cfb expref: 28 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.190988:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f1c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cfb expref: 28 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.191008:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.191011:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890983.191015:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86c00, rc 0) 00000100:00100000:2.0:1788890983.191116:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:10320:x1875787987840768:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 412us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.191122:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:0.0:1788890983.200555:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.200653:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841024 00000100:00100000:2.0:1788890983.200665:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841024 00000100:00100000:2.0:1788890983.200731:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:2.0:1788890983.200742:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8c01450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:10320:x1875787987841024:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788890983.200983:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8c01450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:10320:x1875787987841024:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 242us (442us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788890983.200990:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:3.0:1788890983.250990:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890983.251138:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841280 00000100:00100000:0.0:1788890983.251149:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841280 00000100:00100000:0.0:1788890983.251242:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 46 00000100:00100000:0.0:1788890983.251252:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:10330:x1875787987841280:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890983.251277:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890983.251298:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030000/0x9161b78f8ec3f1c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d02 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890983.251402:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788890983.251525:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030000/0x9161b78f8ec3f1c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d02 expref: 31 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.251540:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:0.0:1788890983.251543:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788890983.251548:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030000/0x9161b78f8ec3f1c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d02 expref: 31 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.251563:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030000, rc 0) 00000100:00100000:0.0:1788890983.251862:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:10330:x1875787987841280:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 611us (881us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788890983.251870:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 46 00000100:00100000:0.0:1788890983.258882:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.259019:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841408 00000100:00100000:2.0:1788890983.259029:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841408 00000100:00100000:2.0:1788890983.259082:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:2.0:1788890983.259091:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:10330:x1875787987841408:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:2.0:1788890983.259163:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259338:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259350:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259364:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259371:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259376:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259743:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259752:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259759:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890983.259798:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259812:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259818:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259835:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259841:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890983.259845:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259853:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259865:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890983.259869:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890983.259873:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259878:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259891:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259896:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259901:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259906:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890983.259909:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259925:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259934:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890983.259936:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890983.259939:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259945:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259960:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259967:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259973:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259978:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890983.259980:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259987:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.259993:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.259995:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890983.259998:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.260012:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.260084:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:10330:x1875787987841408:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 993us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.260092:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:3.0:1788890983.263335:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.263577:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841664 00000100:00100000:2.0:1788890983.263586:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841664 00000100:00100000:2.0:1788890983.264448:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:2.0:1788890983.264465:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:10330:x1875787987841664:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788890983.264829:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:10330:x1875787987841664:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 371us (1503us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788890983.264837:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:3.0:1788890983.292585:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.292919:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987841920 00000100:00100000:2.0:1788890983.292928:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987841920 00000100:00100000:2.0:1788890983.293032:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:2.0:1788890983.293042:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:10333:x1875787987841920:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890983.293066:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890983.293086:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d09 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293162:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293205:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293234:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293248:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293255:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293260:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293396:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293404:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293412:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.293422:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788890983.293515:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293522:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293529:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293535:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890983.293545:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293553:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293566:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890983.293569:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890983.293573:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293579:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f1f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293593:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293599:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293605:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293610:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890983.293613:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293618:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293625:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890983.293627:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890983.293637:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293642:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f1f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293686:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f1ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d09 expref: 34 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293699:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d09 expref: 33 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.293705:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.293707:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890983.293709:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86200, rc 0) 00000100:00100000:2.0:1788890983.293783:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:10333:x1875787987841920:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 742us (1209us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788890983.293790:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:0.0:1788890983.297760:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.298057:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842048 00000100:00100000:1.0:1788890983.298068:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842048 00000100:00100000:1.0:1788890983.298210:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 49 00000100:00100000:1.0:1788890983.298221:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:10333:x1875787987842048:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:1.0:1788890983.298308:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.298323:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.298334:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.298365:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.298373:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.298393:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.298400:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890983.298404:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.298412:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.298422:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:1.0:1788890983.298425:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788890983.298430:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.298435:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f20d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.298513:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:10333:x1875787987842048:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 293us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.298521:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 49 00000100:00100000:3.0:1788890983.300357:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.300508:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842304 00000100:00100000:2.0:1788890983.300516:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842304 00000100:00100000:2.0:1788890983.300600:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:2.0:1788890983.300610:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:10333:x1875787987842304:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788890983.300910:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:10333:x1875787987842304:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 300us (560us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788890983.300917:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:0.0:1788890983.457608:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.457815:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842560 00000100:00100000:2.0:1788890983.457825:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842560 00000100:00100000:2.0:1788890983.457935:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 50 00000100:00100000:2.0:1788890983.457947:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:10364:x1875787987842560:12345-192.168.204.18@tcp:101:cat.0 00010000:00010000:2.0:1788890983.457983:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890983.458004:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f214 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d10 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.458108:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f21b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.458121:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.458132:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.458143:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788890983.458448:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f214 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d10 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.458465:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f21b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d10 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.458473:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.458476:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890983.458480:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87800, rc 0) 00000100:00100000:2.0:1788890983.458717:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:10364:x1875787987842560:12345-192.168.204.18@tcp:101:cat.0 Request processed in 771us (1126us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788890983.458725:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 50 00000100:00100000:0.0:1788890983.461657:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890983.461840:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842688 00000100:00100000:3.0:1788890983.461850:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842688 00000100:00100000:3.0:1788890983.461937:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:3.0:1788890983.461953:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:2374:x1875787987842688:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890983.461976:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890983.462018:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f21b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d10 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.462048:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:3.0:1788890983.462056:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890983.463478:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:2374:x1875787987842688:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 187us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890983.463507:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:0.0:1788890983.466914:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.467301:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987842944 00000100:00100000:1.0:1788890983.467312:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987842944 00000100:00100000:1.0:1788890983.467432:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:1.0:1788890983.467444:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:10364:x1875787987842944:12345-192.168.204.18@tcp:35:cat.0 00000100:00100000:1.0:1788890983.467701:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:10364:x1875787987842944:12345-192.168.204.18@tcp:35:cat.0 Request processed in 258us (797us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788890983.467709:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:0.0:1788890983.478579:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788890983.478604:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996256640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890983.478675:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890983.478816:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996256640 00000100:00100000:1.0:1788890983.478824:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996256640 00000100:00100000:1.0:1788890983.478886:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788890983.478896:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996256640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788890983.478930:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788890983.478978:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996256640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.478985:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788890983.479083:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996256640:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788890983.479194:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788890983.510107:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.510336:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843200 00000100:00100000:2.0:1788890983.510347:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843200 00000100:00100000:2.0:1788890983.510426:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:2.0:1788890983.510454:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:10370:x1875787987843200:12345-192.168.204.18@tcp:101:dd.0 00010000:00010000:2.0:1788890983.510480:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890983.510483:0:6852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788890983.510511:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f181 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ce6 expref: 36 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.510530:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890983.510535:0:6852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890983.510548:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f229 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d17 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.510645:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.510659:0:6852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d09 expref: 36 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.510667:0:6852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.510698:0:6852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d09 expref: 36 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.510712:0:6852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d09 expref: 36 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.510725:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996256768:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890983.510843:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5ade180 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.513074:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.513229:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996256768:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890983.513259:0:6852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890983.513970:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843328 00000100:00100000:3.0:1788890983.513979:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843328 00010000:00010000:3.0:1788890983.514017:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d09 expref: 37 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890983.514101:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:3.0:1788890983.514113:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:2374:x1875787987843328:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890983.514128:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890983.514136:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d09 expref: 37 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.514150:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d09 expref: 37 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.514197:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f1ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d09 expref: 37 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.514215:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:3.0:1788890983.514221:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.514231:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.514239:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.514276:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890983.514332:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:2374:x1875787987843328:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 222us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890983.514340:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 37 00010000:00010000:2.0:1788890983.514719:0:6852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.514727:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.514755:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788890983.514961:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f229 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d17 expref: 37 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.514977:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d17 expref: 36 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.514984:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.514987:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788890983.514990:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86e00, rc 0) 00000100:00100000:2.0:1788890983.515021:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:10370:x1875787987843200:12345-192.168.204.18@tcp:101:dd.0 Request processed in 4571us (4924us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788890983.515028:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:0.0:1788890983.517488:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.517627:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843584 00000100:00100000:1.0:1788890983.517636:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843584 00000100:00100000:1.0:1788890983.517691:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 52 00000100:00100000:1.0:1788890983.517701:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:10370:x1875787987843584:12345-192.168.204.18@tcp:36:dd.0 00010000:00010000:1.0:1788890983.518126:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.518142:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.518159:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788890983.518425:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788890983.518466:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7a15a1b reply state 00000000a0c7f7aa transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.518476:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788890983.518568:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:10370:x1875787987843584:12345-192.168.204.18@tcp:36:dd.0 Request processed in 868us (1086us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788890983.518577:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 52 00000020:00080000:1.0:1788890983.518582:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788890983.524841:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.524863:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.524872:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.524878:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890983.524884:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.524892:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.524910:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:3.0:1788890983.524913:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890983.524918:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890983.524924:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f23e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.542428:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890983.669899:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.670609:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843712 00000100:00100000:2.0:1788890983.670622:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843712 00000100:00100000:2.0:1788890983.670686:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 53 00000100:00100000:2.0:1788890983.670697:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:10384:x1875787987843712:12345-192.168.204.18@tcp:101:stat.0 00010000:00010000:2.0:1788890983.670721:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890983.670759:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f245 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d1e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.670826:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.670840:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.670851:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.670867:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.670874:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.670881:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.670975:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.670985:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d17 expref: 39 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.670992:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.671026:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d17 expref: 39 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.671050:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d17 expref: 39 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.671064:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996256896:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890983.671209:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5adecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.678546:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890983.678614:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987843968 00000100:00100000:3.0:1788890983.678624:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987843968 00000100:00100000:3.0:1788890983.678694:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:3.0:1788890983.678704:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:5601:x1875787987843968:12345-192.168.204.18@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788890983.679114:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+41:5601:x1875787987843968:12345-192.168.204.18@tcp:35:ldlm_bl.0 Request processed in 410us (581us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788890983.679122:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:2.0:1788890983.679519:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996256896:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890983.679549:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890983.682437:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.682622:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844096 00000100:00100000:1.0:1788890983.682633:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844096 00010000:00010000:1.0:1788890983.682676:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d17 expref: 41 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.682998:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 38 00000100:00100000:1.0:1788890983.683010:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+41:2373:x1875787987844096:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890983.683026:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890983.683034:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d17 expref: 41 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.683048:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d17 expref: 41 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.683070:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f230 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d17 expref: 41 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.683107:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:1.0:1788890983.683113:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.683123:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.683131:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.683262:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890983.683315:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:2373:x1875787987844096:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 307us (887us total) trans 0 rc 0/0 00010000:00010000:2.0:1788890983.683321:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.683323:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 38 00010000:00010000:2.0:1788890983.683334:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.683398:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788890983.683404:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890983.683446:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683460:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683469:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683476:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683493:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683500:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890983.683505:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683513:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683523:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890983.683526:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890983.683530:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683536:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f24c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683548:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683554:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683560:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683565:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890983.683568:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683596:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683605:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890983.683608:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890983.683611:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683617:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683664:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f245 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d1e expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683679:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d1e expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.683687:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.683688:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890983.683691:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86600, rc 0) 00000100:00100000:2.0:1788890983.683729:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:10384:x1875787987843712:12345-192.168.204.18@tcp:101:stat.0 Request processed in 13035us (13841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.683738:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 53 00000100:00100000:0.0:1788890983.742945:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.743067:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844352 00000100:00100000:2.0:1788890983.743077:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844352 00000100:00100000:2.0:1788890983.743146:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 54 00000100:00100000:2.0:1788890983.743156:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:10390:x1875787987844352:12345-192.168.204.18@tcp:36:truncate.0 00010000:00010000:2.0:1788890983.743255:0:6852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890983.743280:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f25a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d1e expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.743296:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.743299:0:6852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890983.743531:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.743546:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.743555:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890983.743609:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788890983.743636:0:6852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8165e42 reply state 00000000d61c0cb2 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.743646:0:6852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788890983.743777:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+41:10390:x1875787987844352:12345-192.168.204.18@tcp:36:truncate.0 Request processed in 622us (840us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788890983.743784:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 54 00000020:00080000:2.0:1788890983.743789:0:6852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788890983.746936:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.746954:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.746961:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.746967:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890983.746971:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.746979:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.747013:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:0.0:1788890983.747016:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890983.747020:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.747026:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f261 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890983.838539:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.838960:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844480 00000100:00100000:1.0:1788890983.838969:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844480 00000100:00100000:1.0:1788890983.839074:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 55 00000100:00100000:1.0:1788890983.839084:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:10404:x1875787987844480:12345-192.168.204.18@tcp:101:stat.0 00010000:00010000:1.0:1788890983.839116:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890983.839140:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f268 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.839242:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.839257:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.839269:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.839301:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.839308:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.839315:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840130:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840142:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840150:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890983.840210:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788890983.840215:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788890983.840236:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840246:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840254:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840260:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840275:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840280:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890983.840284:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840290:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840302:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:1.0:1788890983.840304:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890983.840308:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840314:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f26f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840325:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840330:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840335:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840340:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fe00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890983.840342:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840354:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840361:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c32fce00) 00010000:00010000:1.0:1788890983.840363:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890983.840365:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840380:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840410:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f268 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d25 expref: 42 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840422:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d25 expref: 41 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.840429:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:1.0:1788890983.840431:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788890983.840433:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e000, rc 0) 00000100:00100000:1.0:1788890983.840506:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+41:10404:x1875787987844480:12345-192.168.204.18@tcp:101:stat.0 Request processed in 1422us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.840514:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 55 00000100:00100000:3.0:1788890983.904578:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.905265:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844736 00000100:00100000:2.0:1788890983.905276:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844736 00000100:00100000:2.0:1788890983.905344:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 56 00000100:00100000:2.0:1788890983.905356:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+41:10414:x1875787987844736:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890983.905388:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890983.905423:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d2c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.905532:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788890983.905659:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f284 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d2c expref: 43 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.905674:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:2.0:1788890983.905677:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788890983.905681:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d2c expref: 43 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.905696:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86600, rc 0) 00000100:00100000:2.0:1788890983.905760:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:10414:x1875787987844736:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 407us (1204us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788890983.905767:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 56 00000100:00100000:0.0:1788890983.911606:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890983.911840:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987844992 00000100:00100000:3.0:1788890983.911850:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987844992 00000100:00100000:3.0:1788890983.911915:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:3.0:1788890983.911925:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:10414:x1875787987844992:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890983.912241:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+43:10414:x1875787987844992:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 316us (644us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788890983.912249:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:0.0:1788890983.948823:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890983.948933:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987845248 00000100:00100000:2.0:1788890983.948944:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987845248 00000100:00100000:2.0:1788890983.949004:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 57 00000100:00100000:2.0:1788890983.949014:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+43:10420:x1875787987845248:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890983.949046:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890983.949068:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f292 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d33 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.949208:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.949223:0:6852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d25 expref: 44 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.949245:0:6852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.949281:0:6852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d25 expref: 44 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.949294:0:6852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d25 expref: 44 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.949309:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996257024:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890983.949417:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5ade600 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.955019:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.955120:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987845376 00000100:00100000:1.0:1788890983.955129:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987845376 00010000:00010000:1.0:1788890983.955220:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d25 expref: 45 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.955274:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:1.0:1788890983.955286:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+45:2374:x1875787987845376:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890983.955302:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890983.955310:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d25 expref: 45 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.955324:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d25 expref: 45 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.955345:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:1.0:1788890983.955350:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.955359:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.955379:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.955400:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890983.955444:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+45:2374:x1875787987845376:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 161us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.955452:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 39 00010000:00010000:2.0:1788890983.955889:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f27d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d25 expref: 44 pid: 5814 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.955907:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996257024:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890983.955930:0:6852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.955938:0:6852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.955945:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.955964:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788890983.956119:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f292 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d33 expref: 45 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.956147:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d33 expref: 44 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.956154:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.956157:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788890983.956159:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87200, rc 0) 00000100:00100000:2.0:1788890983.956355:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+44:10420:x1875787987845248:12345-192.168.204.18@tcp:101:bash.0 Request processed in 7343us (7542us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788890983.956363:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 57 00000100:00100000:0.0:1788890983.958749:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.959086:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987845632 00000100:00100000:1.0:1788890983.959097:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987845632 00000100:00100000:1.0:1788890983.959236:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 58 00000100:00100000:1.0:1788890983.959248:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+44:10420:x1875787987845632:12345-192.168.204.18@tcp:36:bash.0 00010000:00010000:1.0:1788890983.959586:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.959611:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.959624:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788890983.959682:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788890983.959709:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a9683f3 reply state 00000000408e03cc transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.959718:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788890983.959799:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+47:10420:x1875787987845632:12345-192.168.204.18@tcp:36:bash.0 Request processed in 553us (1057us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788890983.959806:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 58 00000020:00080000:1.0:1788890983.959811:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788890983.962123:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.962140:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.962147:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.962153:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890983.962158:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.962165:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.962207:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.962210:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890983.962215:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.962237:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f2a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890983.965905:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.966163:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987845760 00000100:00100000:1.0:1788890983.966207:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987845760 00000100:00100000:0.0:1788890983.966466:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 59 00000100:00100000:0.0:1788890983.966479:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+46:10420:x1875787987845760:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:0.0:1788890983.966506:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890983.966528:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030000/0x9161b78f8ec3f2ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d3a expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.966614:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.966629:0:11412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d33 expref: 47 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.966636:0:11412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.966689:0:11412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d33 expref: 47 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890983.966703:0:11412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d33 expref: 47 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890983.966720:0:11412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3798700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996257152:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890983.966828:0:11412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c596f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788890983.969034:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890983.969113:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987845888 00000100:00100000:1.0:1788890983.969121:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987845888 00010000:00010000:1.0:1788890983.969158:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d33 expref: 48 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890983.969224:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 40 00000100:00100000:1.0:1788890983.969235:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+48:2375:x1875787987845888:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890983.969248:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890983.969255:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d33 expref: 48 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.969288:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d33 expref: 48 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.969309:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:1.0:1788890983.969314:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.969322:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.969329:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890983.969346:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890983.969402:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+48:2375:x1875787987845888:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 169us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890983.969410:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 40 00010000:00010000:2.0:1788890983.970113:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f299 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d33 expref: 47 pid: 6852 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890983.970133:0:11412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3798700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996257152:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890983.970153:0:11412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.970162:0:11412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.970185:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890983.970232:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788890983.970237:0:11412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890983.970256:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.970285:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030000/0x9161b78f8ec3f2ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d3a expref: 47 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.970301:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d3a expref: 46 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890983.970310:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890983.970322:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890983.970326:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030a00, rc 0) 00000100:00100000:2.0:1788890983.970424:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+46:10420:x1875787987845760:12345-192.168.204.18@tcp:101:bash.0 Request processed in 3947us (4527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890983.970431:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 59 00000100:00100000:0.0:1788890983.973026:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890983.973120:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987846144 00000100:00100000:3.0:1788890983.973129:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987846144 00000100:00100000:3.0:1788890983.973334:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00100000:3.0:1788890983.973346:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+46:10420:x1875787987846144:12345-192.168.204.18@tcp:35:bash.0 00000100:00100000:3.0:1788890983.973643:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+47:10420:x1875787987846144:12345-192.168.204.18@tcp:35:bash.0 Request processed in 298us (624us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788890983.973650:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00100000:0.0:1788890984.031302:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.031829:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987846400 00000100:00100000:2.0:1788890984.031839:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987846400 00000100:00100000:2.0:1788890984.031912:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:2.0:1788890984.031924:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+47:10430:x1875787987846400:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890984.031951:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890984.031973:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f2bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d41 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890984.032353:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788890984.032498:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f2bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d41 expref: 49 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.032514:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:2.0:1788890984.032518:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788890984.032523:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f2bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d41 expref: 49 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.032537:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87200, rc 0) 00000100:00100000:2.0:1788890984.032681:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+48:10430:x1875787987846400:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 759us (1388us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788890984.032830:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:0.0:1788890984.035083:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.035458:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987846528 00000100:00100000:1.0:1788890984.035469:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987846528 00000100:00100000:1.0:1788890984.035573:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:1.0:1788890984.035595:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+48:10430:x1875787987846528:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:1.0:1788890984.035687:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035704:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035716:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035757:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035765:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035772:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035860:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035871:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035877:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890984.035927:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035940:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035945:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035952:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035957:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.035961:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035976:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.035987:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:1.0:1788890984.035990:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890984.035995:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036000:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f2ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036013:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036019:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036024:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036029:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.036031:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036036:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036042:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c32fce00) 00010000:00010000:1.0:1788890984.036044:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890984.036047:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036074:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f2d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036090:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036107:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036114:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036119:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.036122:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036127:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036134:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:1.0:1788890984.036137:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890984.036139:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.036145:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f2d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890984.036251:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+48:10430:x1875787987846528:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 658us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.036259:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:0.0:1788890984.038609:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.038686:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987846784 00000100:00100000:1.0:1788890984.038696:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987846784 00000100:00100000:1.0:1788890984.038758:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:1.0:1788890984.038768:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+48:10430:x1875787987846784:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:1.0:1788890984.038997:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+49:10430:x1875787987846784:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 230us (397us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788890984.039005:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:0.0:1788890984.068691:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.068821:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847040 00000100:00100000:2.0:1788890984.068847:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847040 00000100:00100000:2.0:1788890984.068907:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 62 00000100:00100000:2.0:1788890984.068917:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+49:10433:x1875787987847040:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890984.068941:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890984.068972:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f2df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d48 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069162:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069481:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069494:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069511:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069518:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069524:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069816:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f2f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069827:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069835:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890984.069855:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788890984.069963:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069970:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069977:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069983:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890984.069987:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.069995:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070007:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890984.070010:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890984.070015:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070020:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f2e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070034:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070041:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070058:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070064:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890984.070079:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070086:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070095:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890984.070097:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890984.070100:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070105:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f2ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070151:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f2df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d48 expref: 52 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070446:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d48 expref: 51 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.070458:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890984.070460:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890984.070464:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87400, rc 0) 00000100:00100000:2.0:1788890984.070573:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+51:10433:x1875787987847040:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 1656us (1891us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788890984.070601:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 62 00000100:00100000:0.0:1788890984.076848:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.076890:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890984.077430:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847168 00000100:00100000:3.0:1788890984.077440:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847168 00000100:00100000:3.0:1788890984.077515:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:3.0:1788890984.077526:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3798a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+51:2373:x1875787987847168:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890984.077542:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890984.077600:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f2f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d48 expref: 51 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.077623:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:3.0:1788890984.077629:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890984.077630:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847296 00000100:00100000:2.0:1788890984.077638:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847296 00000100:00100000:2.0:1788890984.077688:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 63 00000100:00100000:3.0:1788890984.077695:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3798a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+51:2373:x1875787987847168:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 169us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.077700:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+51:10433:x1875787987847296:12345-192.168.204.18@tcp:54:lfs.0 00000100:00100000:3.0:1788890984.077708:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 4 00010000:00010000:2.0:1788890984.077756:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.077772:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.077784:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.077809:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.077816:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.077822:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.077828:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890984.077837:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.077846:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.077854:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890984.077863:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788890984.077868:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.077874:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890984.077909:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+50:10433:x1875787987847296:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 213us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.077915:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 63 00000100:00100000:0.0:1788890984.080499:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.080971:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847552 00000100:00100000:1.0:1788890984.080981:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847552 00000100:00100000:1.0:1788890984.081076:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:1.0:1788890984.081087:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+50:10433:x1875787987847552:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:1.0:1788890984.081377:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+51:10433:x1875787987847552:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 280us (875us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788890984.081384:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:1.0:1788890984.178240:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.178355:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847808 00000100:00100000:0.0:1788890984.178375:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847808 00000100:00100000:0.0:1788890984.178479:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 64 00000100:00100000:0.0:1788890984.178491:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+51:10451:x1875787987847808:12345-192.168.204.18@tcp:101:cat.0 00010000:00010000:0.0:1788890984.178519:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890984.178542:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f309 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d4f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.178641:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f310 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.178669:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.178683:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890984.178697:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788890984.178833:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f309 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d4f expref: 54 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.178853:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d4f expref: 53 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.178862:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:0.0:1788890984.178865:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788890984.178868:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29eee00, rc 0) 00000100:00100000:0.0:1788890984.178934:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10451:x1875787987847808:12345-192.168.204.18@tcp:101:cat.0 Request processed in 446us (703us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788890984.178941:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 64 00000100:00100000:0.0:1788890984.200162:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.200383:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987847936 00000100:00100000:2.0:1788890984.200455:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987847936 00000100:00100000:2.0:1788890984.200523:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 65 00000100:00100000:2.0:1788890984.200534:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10452:x1875787987847936:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890984.201134:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890984.201159:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f31e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d56 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.201266:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.201282:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.201294:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890984.201329:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788890984.201333:0:11412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890984.201349:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.202478:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f31e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d56 expref: 55 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.202506:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d56 expref: 54 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.202515:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890984.202518:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890984.202522:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86000, rc 0) 00000100:00100000:2.0:1788890984.202753:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10452:x1875787987847936:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 2219us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.202763:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 65 00000100:00100000:3.0:1788890984.208372:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.208497:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848320 00000100:00100000:2.0:1788890984.208510:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848320 00000100:00100000:2.0:1788890984.208576:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:2.0:1788890984.208587:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10452:x1875787987848320:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788890984.208970:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10452:x1875787987848320:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 384us (617us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788890984.208979:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:1.0:1788890984.213395:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.213503:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848448 00000100:00100000:2.0:1788890984.213514:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848448 00000100:00100000:2.0:1788890984.213626:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:2.0:1788890984.213638:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10452:x1875787987848448:12345-192.168.204.18@tcp:103:lfs.0 00010000:00010000:2.0:1788890984.213653:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788890984.213678:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030a00/0x9161b78f8ec3f2b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d3a expref: 55 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.213718:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f310 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d4f expref: 54 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.213730:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f1c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cfb expref: 53 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.213741:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890984.213750:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890984.213818:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:10452:x1875787987848448:12345-192.168.204.18@tcp:103:lfs.0 Request processed in 183us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.213826:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:0.0:1788890984.218859:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.221083:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848576 00000100:00100000:2.0:1788890984.221099:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848576 00000100:00100000:2.0:1788890984.221203:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 66 00000100:00100000:2.0:1788890984.221214:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:10452:x1875787987848576:12345-192.168.204.18@tcp:58:lfs.0 00010000:00010000:2.0:1788890984.221349:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.221375:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.221387:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788890984.222975:0:6852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788890984.224377:0:6852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788890984.224465:0:6852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788890984.224608:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:10452:x1875787987848576:12345-192.168.204.18@tcp:58:lfs.0 Request processed in 3391us (5759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.224620:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 66 00000100:00100000:0.0:1788890984.241836:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.242024:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848704 00000100:00100000:1.0:1788890984.242034:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848704 00000100:00100000:1.0:1788890984.242093:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 67 00000100:00100000:1.0:1788890984.242103:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:10454:x1875787987848704:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:1.0:1788890984.242124:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890984.242146:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d5d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242255:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242288:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242301:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242318:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242324:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242331:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242429:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242437:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242444:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890984.242478:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788890984.242482:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788890984.242500:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242512:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242531:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242537:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242544:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242550:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.242555:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242562:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242575:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:1.0:1788890984.242578:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890984.242582:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242588:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f33a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242602:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242608:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242613:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242624:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.242627:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242632:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242641:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c32fce00) 00010000:00010000:1.0:1788890984.242643:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890984.242646:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242651:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242681:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d5d expref: 54 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242694:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d5d expref: 53 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.242701:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:1.0:1788890984.242703:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788890984.242706:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e200, rc 0) 00000100:00100000:1.0:1788890984.242783:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10454:x1875787987848704:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 682us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.243470:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 67 00000040:00080000:0.0:1788890984.438670:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788890984.438680:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788890984.438742:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788890984.438749:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788890984.438887:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3798380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996257280:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788890984.441133:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c596fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890984.451540:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3798380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996257280:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788890984.451805:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.452100:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848832 00000100:00100000:1.0:1788890984.452117:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848832 00000100:00100000:1.0:1788890984.452210:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:1.0:1788890984.452222:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10465:x1875787987848832:12345-192.168.204.18@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788890984.452302:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10465:x1875787987848832:12345-192.168.204.18@tcp:900:lhsmtool_posix.0 Request processed in 82us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.452310:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:0.0:1788890984.454607:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.457791:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987848960 00000100:00100000:2.0:1788890984.457809:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987848960 00000100:00100000:2.0:1788890984.457885:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 68 00000100:00100000:2.0:1788890984.457897:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10465:x1875787987848960:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788890984.457930:0:11412:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788890984.458038:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10465:x1875787987848960:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 142us (3438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.458045:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 68 00000100:00100000:2.0:1788890984.462089:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.462238:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849088 00000100:00100000:0.0:1788890984.462248:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849088 00000100:00100000:0.0:1788890984.462303:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 69 00000100:00100000:0.0:1788890984.462313:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10465:x1875787987849088:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788890984.462405:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462423:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462437:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462502:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462510:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462517:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462542:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462551:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462576:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890984.462616:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788890984.462620:0:6852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890984.462634:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462645:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462651:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462658:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462664:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c29ef600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890984.462669:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462676:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462688:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:0.0:1788890984.462691:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890984.462695:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462702:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f34f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462727:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462733:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462739:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462745:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c29eee00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890984.462748:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462753:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462760:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9da1c870ce00) 00010000:00010000:0.0:1788890984.462763:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890984.462766:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462771:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f356 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462785:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462791:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462797:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462808:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c29eea00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890984.462811:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462817:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462825:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:0.0:1788890984.462827:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890984.462830:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.462836:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f35d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.462913:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10465:x1875787987849088:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 Request processed in 600us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.462921:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 69 00000100:00100000:0.0:1788890984.470065:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.470158:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849344 00000100:00100000:1.0:1788890984.470203:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849344 00000100:00100000:1.0:1788890984.470260:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 70 00000100:00100000:1.0:1788890984.470269:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10465:x1875787987849344:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788890984.470290:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890984.470313:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f364 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d64 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470446:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470462:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470474:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890984.470484:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788890984.470573:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470581:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470598:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470604:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.470608:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470616:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470628:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:1.0:1788890984.470630:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788890984.470634:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470640:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f36b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470677:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f364 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d64 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470687:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:1.0:1788890984.470690:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788890984.470693:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f364 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d64 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.470702:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6fe00, rc 0) 00000100:00100000:1.0:1788890984.470766:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10465:x1875787987849344:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 498us (711us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788890984.470782:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 70 00000100:00100000:1.0:1788890984.475217:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.475352:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849472 00000100:00100000:0.0:1788890984.475373:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849472 00000100:00100000:0.0:1788890984.475446:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 71 00000100:00100000:0.0:1788890984.475456:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10465:x1875787987849472:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788890984.475494:0:5815:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788890984.475609:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10465:x1875787987849472:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 154us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.475617:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 71 00000100:00100000:3.0:1788890984.481849:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.482016:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849728 00000100:00100000:0.0:1788890984.482038:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849728 00000100:00100000:0.0:1788890984.482102:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 72 00000100:00100000:0.0:1788890984.482114:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10465:x1875787987849728:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788890984.482134:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890984.482137:0:6852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788890984.482163:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d56 expref: 54 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.482531:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:0.0:1788890984.482536:0:6852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890984.482550:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f379 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d6b expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788890984.482953:0:6852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788890984.483149:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.483164:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.483336:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.483542:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eea00/0x9161b78f8ec3f379 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d6b expref: 56 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.483558:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d6b expref: 55 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.483566:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c870ce00) 00010000:00010000:1.0:1788890984.483568:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788890984.483571:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c29eee00, rc 0) 00000100:00100000:1.0:1788890984.483781:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10465:x1875787987849728:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 1668us (1939us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788890984.483790:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 72 00000100:00100000:2.0:1788890984.488136:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.488378:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987849984 00000100:00100000:0.0:1788890984.488389:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987849984 00000100:00100000:0.0:1788890984.488481:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 73 00000100:00100000:0.0:1788890984.488494:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10465:x1875787987849984:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788890984.488553:0:11412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890984.488580:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29eee00/0x9161b78f8ec3f380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d6b expref: 55 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488614:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c870ce00) 00010000:00010000:0.0:1788890984.488623:0:11412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890984.488645:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488658:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488668:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488694:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488701:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488706:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488796:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488803:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488809:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488814:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c29ef600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890984.488817:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488832:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488842:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:0.0:1788890984.488844:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890984.488848:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488853:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c29ef600/0x9161b78f8ec3f38e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488862:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488867:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488872:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488876:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890984.488878:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488882:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488888:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x72ba4bfb (ffff9da1c870c800) 00010000:00010000:0.0:1788890984.488889:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890984.488891:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.488906:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f395 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x72ba4bfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.488980:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10465:x1875787987849984:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 488us (853us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788890984.488986:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 73 00000100:00100000:0.0:1788890984.491641:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.491783:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850112 00000100:00100000:1.0:1788890984.491793:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850112 00000100:00100000:1.0:1788890984.491854:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 74 00000100:00100000:1.0:1788890984.491865:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10465:x1875787987850112:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788890984.491886:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890984.491909:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f39c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d72 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.491946:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.491958:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.491984:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.492080:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f39c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d72 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.492097:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d72 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.492106:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:1.0:1788890984.492109:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788890984.492113:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e000, rc 0) 00000100:00100000:1.0:1788890984.492207:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10465:x1875787987850112:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 343us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.492216:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 74 00000100:00100000:3.0:1788890984.502141:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.502260:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850368 00000100:00100000:1.0:1788890984.502272:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850368 00000100:00100000:1.0:1788890984.502337:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:1.0:1788890984.502348:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10465:x1875787987850368:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788890984.502444:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.502462:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.502474:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788890984.502774:0:6852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788890984.502784:0:6852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 208351614881ns, next at 209351612458ns, rc = 0 00000004:00010000:1.0:1788890984.502871:0:6852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072902704 reply state 00000000a9c285ab transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890984.502880:0:6852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788890984.502986:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+57:10465:x1875787987850368:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 638us (853us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788890984.502995:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:1.0:1788890984.515823:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00010000:00010000:3.0:1788890984.516026:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.516040:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.516048:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.516055:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fe00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890984.516059:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.516068:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.516085:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:3.0:1788890984.516088:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788890984.516093:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.516107:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.516230:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850496 00000100:00100000:0.0:1788890984.516241:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850496 00000100:00100000:0.0:1788890984.516303:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 76 00000100:00100000:0.0:1788890984.516314:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+56:10465:x1875787987850496:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788890984.516338:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890984.516369:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d79 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.516431:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d79 expref: 57 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.516445:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d79 expref: 57 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.516466:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:0.0:1788890984.516470:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788890984.516472:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8800, rc 0) 00000100:00100000:0.0:1788890984.516540:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+57:10465:x1875787987850496:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 227us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.516557:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 76 00000100:00100000:0.0:1788890984.521406:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890984.521709:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850624 00000100:00100000:3.0:1788890984.521721:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850624 00000100:00100000:3.0:1788890984.521774:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 24 00000100:00100000:3.0:1788890984.521783:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875787987850624:12345-192.168.204.18@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788890984.521825:0:6664:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1788890984.521861:0:6664:0:(genops.c:1385:class_connect()) connect: client 671ae218-3c0c-4db9-9d11-9d6b732a0de5, cookie 0x9161b78f8ec3f3b8 00002000:00100000:3.0:1788890984.521874:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 671ae218-3c0c-4db9-9d11-9d6b732a0de5/ffff9da1ca804800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788890984.521886:0:6664:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788890984.522130:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788890984.522160:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9da1d1b20800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788890984.522251:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2371:x1875787987850624:12345-192.168.204.18@tcp:8:lhsmtool_posix.0 Request processed in 468us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890984.522259:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 24 00000100:00100000:3.0:1788890984.531428:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.531549:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987850752 00000100:00100000:2.0:1788890984.531565:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987850752 00000100:00080000:3.0:1788890984.531647:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890984.531739:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 25 00000100:00100000:2.0:1788890984.531753:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:0:x1875787987850752:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1788890984.566294:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788890984.589214:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1788890984.589239:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000100:00100000:2.0:1788890984.589531:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:0:x1875787987850752:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 57772us (58108us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788890984.589544:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 25 00000100:00100000:2.0:1788890984.595422:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890984.595611:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851008 00000100:00100000:3.0:1788890984.595624:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851008 00000100:00100000:3.0:1788890984.595732:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:3.0:1788890984.595744:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+57:10465:x1875787987851008:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788890984.596415:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+58:10465:x1875787987851008:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 670us (1004us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788890984.596426:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:1.0:1788890984.600263:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.600320:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851264 00000100:00100000:1.0:1788890984.600333:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851264 00000100:00100000:1.0:1788890984.600425:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 77 00000100:00100000:1.0:1788890984.600438:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+58:10465:x1875787987851264:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788890984.600596:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+58:10465:x1875787987851264:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 160us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.600605:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 77 00000100:00100000:2.0:1788890984.604540:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.604825:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851392 00000100:00100000:1.0:1788890984.604836:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851392 00000100:00100000:1.0:1788890984.604906:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 78 00000100:00100000:1.0:1788890984.604919:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+58:10465:x1875787987851392:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788890984.604941:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890984.604975:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f3bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d80 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.605052:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.605067:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.605080:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890984.605306:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788890984.605329:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.605376:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f3bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d80 expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.605397:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d80 expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.605406:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:1.0:1788890984.605410:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788890984.605414:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6fe00, rc 0) 00000100:00100000:1.0:1788890984.605563:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:10465:x1875787987851392:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 647us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.605581:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 78 00000100:00100000:3.0:1788890984.609004:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.609393:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851520 00000100:00100000:0.0:1788890984.609404:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851520 00000100:00100000:0.0:1788890984.609465:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 26 00000100:00100000:0.0:1788890984.609477:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2374:x1875787987851520:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788890984.609495:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890984.609679:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d87 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788890984.609709:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa04f68, blocks: 0x1 00010000:00010000:0.0:1788890984.609728:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=208s v=(0 0) 00010000:00010000:0.0:1788890984.609733:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890984.609742:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d87 expref: 6 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.609763:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d87 expref: 6 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.609778:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9600, rc 0) 00000100:00100000:0.0:1788890984.609836:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987851520:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 362us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.609843:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 26 00000100:00100000:2.0:1788890984.612041:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.612133:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851776 00000100:00100000:0.0:1788890984.612143:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851776 00000100:00100000:0.0:1788890984.612231:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 79 00000100:00100000:0.0:1788890984.612243:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:10465:x1875787987851776:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788890984.612342:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:10465:x1875787987851776:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.612350:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 79 00000100:00100000:0.0:1788890984.616671:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.616869:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987851904 00000100:00100000:1.0:1788890984.616879:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987851904 00000100:00100000:1.0:1788890984.616935:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:1.0:1788890984.616948:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:10465:x1875787987851904:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788890984.616966:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890984.616982:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d8e expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.617013:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d87 expref: 7 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.617024:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788890984.617028:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788890984.617034:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.617066:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d87 expref: 7 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.617080:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d87 expref: 7 pid: 6663 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890984.617119:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f5336a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996257408:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788890984.617225:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1dc0cd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788890984.619403:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.619422:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f5336a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996257408:192.168.204.18@tcp:104: 00010000:00010000:1.0:1788890984.619466:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.619470:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852032 00000100:00100000:0.0:1788890984.619486:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852032 00010000:00010000:1.0:1788890984.619515:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f200, rc 0) 00000100:00100000:1.0:1788890984.619581:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:10465:x1875787987851904:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 2633us (2981us total) trans 0 rc 0/0 00010000:00010000:0.0:1788890984.619591:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d87 expref: 8 pid: 6663 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890984.619593:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:0.0:1788890984.619703:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00100000:0.0:1788890984.619714:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2375:x1875787987852032:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890984.619729:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890984.619755:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d87 expref: 7 pid: 6663 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.619768:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d87 expref: 7 pid: 6663 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.619790:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d4b25e5/0x9161b78f8ec3f3cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d87 expref: 7 pid: 6663 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.619804:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890984.619808:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890984.619816:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.619832:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.619865:0:6679:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.619878:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f33b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6679:1875787996257536:192.168.204.18@tcp:105: 00000100:00100000:0.0:1788890984.620576:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1fb91ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788890984.629342:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f33b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6679:1875787996257536:192.168.204.18@tcp:105: 00010000:00010000:1.0:1788890984.629396:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890984.629476:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987852032:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 9761us (10084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.629490:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00100000:3.0:1788890984.630214:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.630296:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852160 00000100:00100000:0.0:1788890984.630318:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852160 00002000:00100000:0.0:1788890984.630393:0:6669:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9da201c5a680 x1875787987852160/t0(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:35/0 lens 504/0 e 0 to 0 dl 1788890995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788890984.630406:0:6669:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da201c5a680 with x1875787987852160 ext(0->8) 00002000:00010000:0.0:1788890984.630413:0:6669:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da201c5a680 00000100:00100000:0.0:1788890984.630452:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:0.0:1788890984.630464:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987852160:12345-192.168.204.18@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788890984.632572:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2374:x1875787987852160:12345-192.168.204.18@tcp:4:lhsmtool_posix.0 Request processed in 2100us (2416us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788890984.632585:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 0 00002000:00100000:0.0:1788890984.632598:0:6669:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9da201c5a680 x1875787987852160/t4294967302(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:35/0 lens 504/448 e 0 to 0 dl 1788890995 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788890984.632607:0:6669:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da201c5a680 with x1875787987852160 ext(0->8) 00002000:00010000:0.0:1788890984.632613:0:6669:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da201c5a680 00000100:00100000:3.0:1788890984.637803:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.637904:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852288 00000100:00100000:2.0:1788890984.637914:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852288 00000100:00100000:2.0:1788890984.638021:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 80 00000100:00100000:2.0:1788890984.638031:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:10465:x1875787987852288:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788890984.698567:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1788890984.698589:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1788890984.698594:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788890984.698651:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788890984.698669:0:5836:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9da1c85643c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788890984.698674:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1c3756b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9da1c85649c0 00000020:00080000:1.0:1788890984.698677:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1c3756800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9da1fbb30000 00000001:00080000:1.0:1788890984.698703:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1788890984.698850:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788890984.698960:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788890984.698981:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f5336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996257664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788890984.699050:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890984.699118:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996257664 00000100:00100000:1.0:1788890984.699125:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996257664 00000100:00100000:2.0:1788890984.699323:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:10465:x1875787987852288:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 Request processed in 61290us (61526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.699334:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 80 00000100:00100000:3.0:1788890984.699411:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788890984.699423:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996257664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788890984.699447:0:6664:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788890984.699482:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa04f67, atime: 0x6aa04f67, ctime: 0x6aa04f67, blocks: 0x1 00010000:00010000:3.0:1788890984.699491:0:6664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.699506:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=208s v=(0 0) 00010000:00010000:3.0:1788890984.699511:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890984.699517:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.699536:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.699547:0:6664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.699555:0:6664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.699578:0:6664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788890984.699793:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890984.699800:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.699808:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4eddc00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890984.699812:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.699821:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.699839:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.699847:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3f3db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.699869:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890984.699872:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890984.699873:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890984.699934:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788890984.699948:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788890984.701010:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1875787996257664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1585us (1955us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788890984.701027:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788890984.701059:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996257792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788890984.701108:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890984.701252:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996257792 00000100:00100000:3.0:1788890984.701259:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996257792 00000004:00080000:1.0:1788890984.701344:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da1f5336a00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788890984.701364:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f5336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996257664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788890984.701475:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788890984.701487:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996257792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788890984.701634:0:6662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788890984.701638:0:6662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788890985 00002000:00010000:2.0:1788890984.701640:0:6662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788890984.701643:0:6662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788890984 -> 1788890985 00002000:00010000:2.0:1788890984.701645:0:6662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788890984.701733:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875787996257792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (624us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788890984.701741:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788890984.701955:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da201c5aa00/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788890984.701961:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996257792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788890984.703998:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.704204:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852416 00000100:00100000:1.0:1788890984.704212:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852416 00000100:00100000:1.0:1788890984.704267:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 30 00000100:00100000:1.0:1788890984.704278:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987852416:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788890984.748851:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788890984.748874:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788890984.748947:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987852416:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 Request processed in 44663us (44946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890984.748960:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 30 00000100:00100000:1.0:1788890984.751413:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.751548:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852672 00000100:00100000:0.0:1788890984.751561:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852672 00000100:00100000:0.0:1788890984.751624:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 81 00000100:00100000:0.0:1788890984.751635:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:10465:x1875787987852672:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788890984.751692:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890984.751730:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f3c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d80 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.751751:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:0.0:1788890984.751756:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890984.751787:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.751801:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.751810:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890984.752063:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a10dbe9 reply state 000000000eb2d31f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.752074:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890984.752210:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:10465:x1875787987852672:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 577us (806us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788890984.752217:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 81 00010000:00010000:2.0:1788890984.758867:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.758888:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.758896:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.758903:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890984.758908:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.758916:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.758935:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:2.0:1788890984.758938:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890984.758944:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.758950:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f3e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890984.763433:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.763837:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987852800 00000100:00100000:0.0:1788890984.763847:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987852800 00000100:00100000:0.0:1788890984.763907:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 31 00000100:00100000:0.0:1788890984.763918:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987852800:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788890984.764259:0:11963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788890984.764263:0:11963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788890985 -> 1788890984 00002000:00010000:0.0:1788890984.764340:0:11963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788890983 00002000:00010000:0.0:1788890984.764343:0:11963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788890985 -> 1788890984 00002000:00010000:0.0:1788890984.764345:0:11963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788890984.764423:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987852800:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 506us (1000us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788890984.764431:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 31 00000100:00100000:0.0:1788890984.770937:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890984.770992:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853056 00000100:00100000:3.0:1788890984.771003:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853056 00000100:00100000:3.0:1788890984.771065:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 82 00000100:00100000:3.0:1788890984.771077:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:10465:x1875787987853056:12345-192.168.204.18@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788890984.771193:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.771212:0:6852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d72 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.771221:0:6852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.771252:0:6852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d72 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.771266:0:6852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d72 expref: 13 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890984.771291:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996257920:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890984.771389:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201c54f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788890984.778828:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.778912:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853184 00000100:00100000:0.0:1788890984.778921:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853184 00010000:00010000:0.0:1788890984.778962:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d72 expref: 14 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.779007:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 42 00000100:00100000:0.0:1788890984.779017:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:2374:x1875787987853184:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890984.779032:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890984.779040:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d72 expref: 14 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.779053:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d72 expref: 14 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.779075:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:0.0:1788890984.779080:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.779103:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.779111:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.779130:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890984.779198:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:2374:x1875787987853184:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 182us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.779207:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 42 00010000:00010000:1.0:1788890984.779329:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f3a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d72 expref: 13 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890984.779360:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996257920:192.168.204.18@tcp:104: 00010000:00010000:1.0:1788890984.779380:0:6852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.779390:0:6852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.779397:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.779425:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.779445:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.779451:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.779457:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.779461:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.779468:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.779478:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:1.0:1788890984.779481:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788890984.779485:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.779491:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f3e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890984.779862:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+12:10465:x1875787987853056:12345-192.168.204.18@tcp:55:lhsmtool_posix.0 Request processed in 8786us (8931us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788890984.779872:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 82 00000100:00100000:3.0:1788890984.788499:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890984.788616:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853312 00000100:00100000:0.0:1788890984.788627:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853312 00000100:00100000:0.0:1788890984.788684:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 32 00000100:00100000:0.0:1788890984.788695:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987853312:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788890984.788741:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.788761:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.788771:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890984.788775:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788890984.788780:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.788814:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.788842:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 7 pid: 6662 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.788858:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6663:1875787996258048:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890984.788947:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92c6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890984.791685:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6663:1875787996258048:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890984.792158:0:6663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890984.792749:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.792803:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853440 00000100:00100000:2.0:1788890984.792811:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853440 00010000:00010000:2.0:1788890984.792845:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 8 pid: 6662 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890984.792888:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:2.0:1788890984.792898:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987853440:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890984.792913:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890984.792936:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 8 pid: 6662 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.792949:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 8 pid: 6662 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.792974:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000098f05dd/0x9161b78f8ec3f3d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d8e expref: 8 pid: 6662 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.792990:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890984.792994:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890984.792999:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.793009:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.793039:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890984.793095:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2375:x1875787987853440:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 199us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.793103:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 43 00010000:00010000:3.0:1788890984.793217:0:6663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.793269:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.793297:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.793305:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.793314:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.793334:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890984.793339:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.793361:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.793375:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890984.793382:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009ba0245/0x9161b78f8ec3f3f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890984.793444:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2373:x1875787987853312:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 Request processed in 4749us (4954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890984.793453:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 32 00000100:00100000:3.0:1788890984.795692:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.795756:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853696 00000100:00100000:2.0:1788890984.795765:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853696 00000100:00100000:2.0:1788890984.795810:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 83 00000100:00100000:2.0:1788890984.795820:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+12:10465:x1875787987853696:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788890984.795897:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.795915:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.795927:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.796210:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.796223:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d79 expref: 13 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.796231:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.796267:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d79 expref: 13 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.796280:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d79 expref: 13 pid: 11412 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890984.796306:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0755f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996258176:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890984.796394:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1fb91c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788890984.800991:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0755f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996258176:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890984.801024:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890984.801701:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.801737:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853824 00000100:00100000:2.0:1788890984.801744:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853824 00010000:00010000:2.0:1788890984.801783:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d79 expref: 14 pid: 11412 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890984.801818:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 44 00000100:00100000:2.0:1788890984.801829:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:2374:x1875787987853824:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890984.801844:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890984.801851:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d79 expref: 14 pid: 11412 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.801863:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d79 expref: 14 pid: 11412 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.801885:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f3b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d79 expref: 14 pid: 11412 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.801899:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:2.0:1788890984.801912:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.801922:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.801930:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.801951:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890984.802002:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:2374:x1875787987853824:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 175us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.802010:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 44 00010000:00010000:2.0:1788890984.802107:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.802115:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890984.802326:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788890984.802678:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788890984.802736:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788890984.802845:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1875787996258304:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788890984.802892:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890984.802920:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1fb91ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788890984.802952:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996258304 00000100:00100000:2.0:1788890984.802959:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996258304 00000100:00100000:2.0:1788890984.802996:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890984.803006:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1875787996258304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788890984.803079:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1875787996258304:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890984.803092:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788890984.803136:0:5816:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788890984.803141:0:5816:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da201c5aa00, transno 4294967303 00000100:00100000:2.0:1788890984.803156:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1875787996258304:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788890984.803734:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788890984.803793:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1875787996258432:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788890984.803830:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890984.803849:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8ba4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890984.804044:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996258432 00000100:00100000:2.0:1788890984.804049:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996258432 00000100:00100000:2.0:1788890984.804078:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890984.804084:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1875787996258432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788890984.804279:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1875787996258432:12345-0@lo:1000:mdt00_002.0 Request processed in 194us (448us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788890984.804287:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788890984.804334:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1875787996258432:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788890984.804376:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804386:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804395:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804401:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890984.804406:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804422:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804438:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:2.0:1788890984.804441:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890984.804445:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804451:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f3fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804482:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804489:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804496:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804501:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890984.804504:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804509:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804518:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890984.804520:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890984.804523:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804540:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f32c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804565:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804578:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d5d expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.804586:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.805840:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d5d expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.805858:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d5d expref: 16 pid: 5814 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890984.805872:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996258560:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890984.805949:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8ba4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890984.809780:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.809846:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996258560:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890984.809873:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.809933:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987853952 00000100:00100000:0.0:1788890984.809940:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987853952 00010000:00010000:0.0:1788890984.809978:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d5d expref: 17 pid: 5814 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890984.810015:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:0.0:1788890984.810026:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:2375:x1875787987853952:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890984.810039:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890984.810047:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d5d expref: 17 pid: 5814 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.810061:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d5d expref: 17 pid: 5814 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.810083:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d5d expref: 17 pid: 5814 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.810098:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:0.0:1788890984.810103:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.810125:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.810132:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890984.810155:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890984.810250:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810339:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810364:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810372:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810378:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810385:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890984.810389:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810397:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810407:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890984.810411:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890984.810414:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810419:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f405 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810433:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810438:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810451:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810456:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890984.810460:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810466:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810474:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890984.810476:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788890984.810479:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.810484:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f3f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788890984.811444:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788890984.811450:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788890984.811481:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788890984.811488:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788890984.811587:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:10465:x1875787987853696:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 15764us (15900us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788890984.811598:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 83 00000020:00080000:2.0:1788890984.811604:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788890984.811962:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:2375:x1875787987853952:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 1935us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890984.811972:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:3.0:1788890984.816372:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890984.816601:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854208 00000100:00100000:2.0:1788890984.816613:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854208 00000100:00100000:2.0:1788890984.816672:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 20 00000100:00100000:2.0:1788890984.816682:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:10465:x1875787987854208:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788890984.817756:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788890984.817857:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788890984.817910:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.817927:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.817938:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.817946:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.817953:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.817959:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.817976:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788890984.818059:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:10465:x1875787987854208:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 1376us (1706us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788890984.818067:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 20 00000020:00080000:2.0:1788890984.818072:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788890984.818098:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890984.818104:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.818111:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87c00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890984.818115:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.818130:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.818144:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890984.818147:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788890984.818152:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.818158:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f40c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890984.818210:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890984.818212:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890984.818214:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788890984.881777:0:11984:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788890984.881786:0:11984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788890984.881825:0:11984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788890984.881832:0:11984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788890984.959483:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.962764:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854464 00000100:00100000:1.0:1788890984.962785:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854464 00000100:00100000:1.0:1788890984.962868:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 84 00000100:00100000:1.0:1788890984.962881:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:10476:x1875787987854464:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:1.0:1788890984.962911:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890984.962948:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f413 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d95 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.963050:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f41a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.963064:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f41a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.963076:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f41a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890984.963087:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788890984.963245:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f413 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d95 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.963265:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f41a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d95 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.963274:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:1.0:1788890984.963277:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788890984.963281:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f200, rc 0) 00000100:00100000:1.0:1788890984.963365:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:10476:x1875787987854464:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 486us (3897us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788890984.963373:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 84 00000100:00100000:2.0:1788890984.967020:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890984.967072:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854592 00000100:00100000:1.0:1788890984.967082:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854592 00000100:00100000:1.0:1788890984.967144:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 85 00000100:00100000:1.0:1788890984.967155:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:10476:x1875787987854592:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:1.0:1788890984.967264:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967281:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967292:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967307:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967315:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967322:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967539:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967548:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967555:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890984.967591:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967602:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967617:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967624:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967639:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.967644:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967651:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967662:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:1.0:1788890984.967665:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890984.967670:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967676:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f428 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967686:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967692:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967698:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967704:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.967711:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967717:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967724:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c32fc400) 00010000:00010000:1.0:1788890984.967726:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890984.967728:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967734:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f42f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967746:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967752:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967758:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967762:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fe00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890984.967765:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967771:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967776:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c32fcd00) 00010000:00010000:1.0:1788890984.967778:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890984.967785:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890984.967791:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890984.967860:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:10476:x1875787987854592:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 707us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890984.967868:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 85 00000100:00100000:0.0:1788890985.001109:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.001230:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854848 00000100:00100000:2.0:1788890985.001240:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854848 00000100:00100000:2.0:1788890985.001314:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 86 00000100:00100000:2.0:1788890985.001326:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:10479:x1875787987854848:12345-192.168.204.18@tcp:101:lfs.0 00000100:00080000:0.0:1788890985.001331:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788890985.001370:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.001390:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f43d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1d9c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001462:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001476:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001488:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001510:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001517:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001524:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001789:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001799:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001806:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890985.001816:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788890985.001914:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001921:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001928:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001934:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.001939:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001955:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001967:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.001970:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.001975:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001981:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f444 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001991:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.001996:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.002001:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.002005:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.002008:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.002013:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.002020:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aee600) 00010000:00010000:2.0:1788890985.002022:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.002025:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.002040:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f44b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.002079:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f43d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d9c expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.002092:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d9c expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.002099:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890985.002101:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890985.002103:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86200, rc 0) 00000100:00100000:2.0:1788890985.002192:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:10479:x1875787987854848:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 868us (1090us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788890985.002199:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 86 00000100:00100000:3.0:1788890985.006359:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.006400:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987854976 00000100:00100000:3.0:1788890985.006410:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987854976 00000100:00100000:3.0:1788890985.006467:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 87 00000100:00100000:3.0:1788890985.006477:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:10479:x1875787987854976:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:3.0:1788890985.006549:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.006578:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.006590:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.006616:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.006622:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.006644:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.006651:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edce00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890985.006655:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.006662:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.006674:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:3.0:1788890985.006678:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788890985.006683:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.006690:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.006759:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:10479:x1875787987854976:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 282us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.006773:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 87 00000100:00100000:0.0:1788890985.009861:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.009948:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987855232 00000100:00100000:3.0:1788890985.009957:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987855232 00000100:00100000:3.0:1788890985.010041:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:3.0:1788890985.010052:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8c02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:10479:x1875787987855232:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890985.010289:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8c02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:10479:x1875787987855232:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 238us (435us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788890985.010297:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:2.0:1788890985.015514:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996258816:0@lo:400:kworker.0 00000100:00100000:2.0:1788890985.015583:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890985.015639:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788890985.015645:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996258944:0@lo:400:kworker.0 00000100:00100000:2.0:1788890985.015670:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890985.015705:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996258816 00000100:00100000:2.0:1788890985.015713:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996258816 00000100:00100000:2.0:1788890985.015753:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996258944 00000100:00100000:2.0:1788890985.015756:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996258944 00000100:00100000:2.0:1788890985.015787:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788890985.015795:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996258816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890985.015853:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996258816:12345-0@lo:400:kworker.0 Request processed in 59us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.015860:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788890985.015877:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788890985.015882:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996258944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890985.015904:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996258944:12345-0@lo:400:kworker.0 Request processed in 23us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.015909:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788890985.015926:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788890985.015951:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996258944:0@lo:400:kworker.0 00000100:00100000:2.0:1788890985.015961:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996258816:0@lo:400:kworker.0 00000100:00100000:0.0:1788890985.016026:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996258688:0@lo:400:kworker.0 00000100:00100000:0.0:1788890985.016060:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890985.016097:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788890985.016103:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996259072:0@lo:400:kworker.0 00000100:00100000:0.0:1788890985.016125:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890985.016209:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996258688 00000100:00100000:2.0:1788890985.016213:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996258688 00000100:00100000:2.0:1788890985.016241:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788890985.016247:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996258688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890985.016283:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3282:x1875787996258688:12345-0@lo:400:kworker.0 Request processed in 37us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.016289:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788890985.016321:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996258688:0@lo:400:kworker.0 00000100:00100000:3.0:1788890985.016434:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996259072 00000100:00100000:3.0:1788890985.016440:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996259072 00000100:00100000:3.0:1788890985.016485:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788890985.016494:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996259072:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788890985.016523:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890985.016561:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875787996259072:12345-0@lo:400:kworker.0 Request processed in 68us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.016569:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788890985.016592:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996259072:0@lo:400:kworker.0 00000100:00100000:3.0:1788890985.040681:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.041845:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987855488 00000100:00100000:2.0:1788890985.041857:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987855488 00000100:00100000:2.0:1788890985.041928:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 88 00000100:00100000:2.0:1788890985.041939:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:10009:x1875787987855488:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890985.041976:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.041995:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f467 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1da3 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.042091:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.042106:0:11412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d9c expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.042114:0:11412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.042146:0:11412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d9c expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.042160:0:11412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d9c expref: 23 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.042213:0:11412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996259200:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890985.042289:0:11412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c55b0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788890985.047275:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.047302:0:11412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996259200:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890985.047327:0:11412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.047400:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987855616 00000100:00100000:0.0:1788890985.047408:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987855616 00010000:00010000:0.0:1788890985.047445:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d9c expref: 24 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.047506:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 46 00000100:00100000:0.0:1788890985.047517:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:2374:x1875787987855616:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890985.047532:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890985.047539:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d9c expref: 24 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.047551:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d9c expref: 24 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.047709:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f452 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d9c expref: 24 pid: 5816 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.047725:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:0.0:1788890985.047730:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.047739:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.047746:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.047779:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890985.048084:0:11412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.048092:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890985.048110:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788890985.048291:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f467 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1da3 expref: 25 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.048307:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1da3 expref: 24 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.048314:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:1.0:1788890985.048317:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788890985.048320:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87200, rc 0) 00000100:00100000:0.0:1788890985.048571:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:2374:x1875787987855616:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 1045us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.048580:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 46 00000100:00100000:1.0:1788890985.048631:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:10009:x1875787987855488:12345-192.168.204.18@tcp:101:bash.0 Request processed in 6694us (7959us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788890985.048638:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 88 00000100:00100000:1.0:1788890985.052769:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.052942:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987855872 00000100:00100000:2.0:1788890985.052962:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987855872 00000100:00100000:2.0:1788890985.053027:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 89 00000100:00100000:2.0:1788890985.053045:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:10009:x1875787987855872:12345-192.168.204.18@tcp:36:bash.0 00010000:00010000:2.0:1788890985.053414:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.053438:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.053455:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890985.053531:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788890985.053573:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013258c03 reply state 00000000c6f0cfac transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.053585:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788890985.053652:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788890985.053804:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:10009:x1875787987855872:12345-192.168.204.18@tcp:36:bash.0 Request processed in 757us (1041us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788890985.053813:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 89 00000020:00080000:2.0:1788890985.053818:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788890985.057131:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.057163:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.057315:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.057322:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890985.057327:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.057336:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.057363:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:0.0:1788890985.057367:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890985.057372:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.057379:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f47c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.059796:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.059998:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856000 00000100:00100000:3.0:1788890985.060009:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856000 00000100:00100000:3.0:1788890985.060070:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 90 00000100:00100000:3.0:1788890985.060081:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:10009:x1875787987856000:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:3.0:1788890985.060105:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890985.060126:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f483 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1daa expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.060312:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f483 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1daa expref: 27 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.060360:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f483 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1daa expref: 27 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.060382:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:3.0:1788890985.060386:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788890985.060390:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edce00, rc 0) 00000100:00100000:3.0:1788890985.060491:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:10009:x1875787987856000:12345-192.168.204.18@tcp:101:bash.0 Request processed in 410us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.060499:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 90 00000100:00100000:3.0:1788890985.062336:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.062386:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856128 00000100:00100000:2.0:1788890985.062393:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856128 00000100:00100000:2.0:1788890985.062440:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:2.0:1788890985.062449:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:10009:x1875787987856128:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890985.062463:0:6664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.062483:0:6664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1db1 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788890985.062510:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa04f68, atime: 0x6aa04f67, ctime: 0x6aa04f68, blocks: 0xb 00010000:00010000:2.0:1788890985.062541:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=208s v=(0 0) 00010000:00010000:2.0:1788890985.062547:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890985.062555:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db1 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.062570:0:6664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db1 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.062583:0:6664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86c00, rc 0) 00000100:00100000:2.0:1788890985.062628:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:10009:x1875787987856128:12345-192.168.204.18@tcp:101:bash.0 Request processed in 179us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.062636:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:1.0:1788890985.065481:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.066403:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856256 00000100:00100000:3.0:1788890985.066414:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856256 00002000:00010000:3.0:1788890985.066459:0:6667:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788890985.066465:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1f5337480 with x1875787987856256 ext(0->18446744073709551615) 00002000:00010000:3.0:1788890985.066476:0:6667:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1f5337480. 00000100:00100000:3.0:1788890985.066573:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:3.0:1788890985.066597:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2372:x1875787987856256:12345-192.168.204.18@tcp:10:bash.0 00002000:00010000:3.0:1788890985.066905:0:6667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788890985.066909:0:6667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788890984 -> 1788890985 00002000:00010000:3.0:1788890985.066911:0:6667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788890983 -> 1788890983 00002000:00010000:3.0:1788890985.066913:0:6667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788890984 -> 1788890985 00002000:00010000:3.0:1788890985.066915:0:6667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788890985.066987:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2372:x1875787987856256:12345-192.168.204.18@tcp:10:bash.0 Request processed in 406us (1515us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788890985.067006:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 1 00002000:00010000:3.0:1788890985.067024:0:6667:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788890985.067027:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1f5337480 with x1875787987856256 ext(0->18446744073709551615) 00002000:00010000:3.0:1788890985.067032:0:6667:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1f5337480. 00000100:00100000:1.0:1788890985.125864:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.125979:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856384 00000100:00100000:2.0:1788890985.125989:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856384 00000100:00100000:2.0:1788890985.126107:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 91 00000100:00100000:2.0:1788890985.126129:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:10493:x1875787987856384:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:2.0:1788890985.126242:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126261:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126273:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126288:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126296:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126310:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126550:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126561:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126568:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890985.126607:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126619:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126625:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126632:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126638:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.126642:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126649:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126661:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.126686:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.126691:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126698:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126711:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126716:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126721:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126726:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.126729:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126736:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126744:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.126747:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.126750:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126755:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126771:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126783:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126788:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126794:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.126796:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126803:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126813:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890985.126815:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.126818:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.126824:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f49f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.126891:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:10493:x1875787987856384:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 763us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.126901:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 91 00000100:00100000:1.0:1788890985.158492:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.160240:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856640 00000100:00100000:2.0:1788890985.160252:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856640 00000100:00100000:2.0:1788890985.160316:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 92 00000100:00100000:2.0:1788890985.160324:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:10496:x1875787987856640:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890985.160360:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.160392:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1db8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.160468:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.160481:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.160491:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.160502:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.160506:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.160510:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.160879:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f4bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.160888:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f4bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.160895:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f4bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890985.160910:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788890985.161019:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161036:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161042:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161049:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.161057:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161078:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161094:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.161096:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.161102:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161107:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161120:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161125:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161130:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161135:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.161142:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161148:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161156:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.161159:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.161162:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161219:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161257:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db8 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161268:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f4bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db8 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.161274:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890985.161276:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788890985.161278:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86000, rc 0) 00000100:00100000:2.0:1788890985.161350:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:10496:x1875787987856640:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 1018us (2863us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788890985.161357:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 92 00000100:00100000:3.0:1788890985.167288:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.167397:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987856768 00000100:00100000:0.0:1788890985.167407:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987856768 00000100:00100000:0.0:1788890985.167462:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 93 00000100:00100000:0.0:1788890985.167473:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:10496:x1875787987856768:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:0.0:1788890985.167887:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.167907:0:6852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1da3 expref: 29 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.167935:0:6852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.167972:0:6852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1da3 expref: 29 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.167985:0:6852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1da3 expref: 29 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.168000:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f32680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996259328:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890985.168105:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c95a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788890985.170888:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f32680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996259328:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890985.170930:0:6852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.171989:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.172067:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857024 00000100:00100000:0.0:1788890985.172073:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857024 00000100:00100000:0.0:1788890985.172154:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 22 00000100:00100000:0.0:1788890985.172162:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:5601:x1875787987857024:12345-192.168.204.18@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788890985.172509:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:5601:x1875787987857024:12345-192.168.204.18@tcp:35:ldlm_bl.0 Request processed in 346us (522us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788890985.172518:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 22 00000100:00100000:3.0:1788890985.175004:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.177191:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857152 00000100:00100000:2.0:1788890985.177206:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857152 00010000:00010000:2.0:1788890985.177256:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1da3 expref: 31 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.177332:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:2.0:1788890985.177356:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:2374:x1875787987857152:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890985.177374:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890985.177381:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1da3 expref: 31 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.177396:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1da3 expref: 31 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.177417:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f46e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1da3 expref: 31 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.177433:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890985.177438:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.177448:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.177456:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.177550:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890985.177613:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:2374:x1875787987857152:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 271us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.177621:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 47 00010000:00010000:3.0:1788890985.177989:0:6852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.177999:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.178032:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.178039:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.178047:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.178052:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890985.178057:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.178064:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.178075:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:3.0:1788890985.178077:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788890985.178081:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.178099:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f4c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.178239:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:10496:x1875787987856768:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 10766us (10960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.178247:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 93 00000100:00100000:3.0:1788890985.183107:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.183224:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857408 00000100:00100000:2.0:1788890985.183333:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857408 00000100:00100000:3.0:1788890985.183488:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:3.0:1788890985.183500:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:10496:x1875787987857408:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890985.183766:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:10496:x1875787987857408:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 268us (667us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788890985.183774:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:1.0:1788890985.232549:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.232818:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857664 00000100:00100000:2.0:1788890985.232828:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857664 00000100:00100000:2.0:1788890985.232900:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 94 00000100:00100000:2.0:1788890985.232910:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:10507:x1875787987857664:12345-192.168.204.18@tcp:101:cat.0 00010000:00010000:2.0:1788890985.232939:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.232971:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1dbf expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233052:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233068:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233080:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233095:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233102:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233109:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233491:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233501:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233520:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890985.233531:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788890985.233630:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233638:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233646:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233653:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.233658:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233666:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233679:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.233682:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.233687:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233694:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f4d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233706:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233712:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233724:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233730:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.233734:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233741:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233749:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.233752:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.233754:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233760:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233802:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dbf expref: 33 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233815:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dbf expref: 32 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.233823:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890985.233825:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890985.233828:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87a00, rc 0) 00000100:00100000:2.0:1788890985.233969:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:10507:x1875787987857664:12345-192.168.204.18@tcp:101:cat.0 Request processed in 1060us (1432us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788890985.233986:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 94 00000100:00100000:1.0:1788890985.237442:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.237540:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987857920 00000100:00100000:0.0:1788890985.237550:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987857920 00000100:00100000:0.0:1788890985.237598:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 24 00000100:00100000:0.0:1788890985.237608:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:10507:x1875787987857920:12345-192.168.204.18@tcp:35:cat.0 00000100:00100000:0.0:1788890985.237912:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:10507:x1875787987857920:12345-192.168.204.18@tcp:35:cat.0 Request processed in 305us (479us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788890985.237921:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 24 00000100:00100000:3.0:1788890985.251113:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.251236:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858176 00000100:00100000:2.0:1788890985.251246:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858176 00000100:00100000:2.0:1788890985.251487:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 95 00000100:00100000:2.0:1788890985.251497:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:10508:x1875787987858176:12345-192.168.204.18@tcp:36:rm.0 00010000:00010000:2.0:1788890985.251562:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788890985.251585:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f4e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dbf expref: 33 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251610:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f4bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db8 expref: 32 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251622:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f483 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1daa expref: 31 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251632:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890985.251645:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890985.251665:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251679:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251689:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251704:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251729:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251736:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251980:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251989:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.251995:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788890985.252901:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:2.0:1788890985.253035:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253095:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253107:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253115:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253123:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253128:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253199:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788890985.253262:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788890985.253269:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.253277:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788890985.253282:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.253290:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.253302:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:1.0:1788890985.253305:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788890985.253309:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253316:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253323:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253328:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253333:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.253337:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253358:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253366:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:2.0:1788890985.253369:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788890985.253372:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253379:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f501 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.253391:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f508 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253395:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253401:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.253405:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890985.253406:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.253407:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890985.253409:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890985.253417:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.253420:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253426:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253435:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.253437:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.253440:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.253446:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f4f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890985.253455:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7a1f693 reply state 000000000dab4b37 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.253464:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788890985.253550:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:10508:x1875787987858176:12345-192.168.204.18@tcp:36:rm.0 Request processed in 2052us (2444us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788890985.253559:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 95 00010000:00010000:2.0:1788890985.254862:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.254876:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.254883:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.254902:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.254906:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.254913:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.254925:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.254927:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.254931:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.254938:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f4fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.288286:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.288426:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858432 00000100:00100000:0.0:1788890985.288436:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858432 00000100:00100000:0.0:1788890985.288560:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 96 00000100:00100000:0.0:1788890985.288581:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:10514:x1875787987858432:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:0.0:1788890985.288611:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890985.288637:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f50f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1dc6 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.288780:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.288797:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.288808:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.288826:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.288833:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.288840:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788890985.289455:0:6852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788890985.289627:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289637:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289646:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289683:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289692:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289699:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289706:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890985.289710:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289718:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289730:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:0.0:1788890985.289733:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890985.289739:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289745:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f516 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890985.289769:0:6852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008893a51a reply state 000000007e97f504 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.289778:0:6852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788890985.289807:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f50f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dc6 expref: 34 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289821:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dc6 expref: 33 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.289829:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:0.0:1788890985.289831:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788890985.289833:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8600, rc 0) 00000100:00100000:0.0:1788890985.289962:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:10514:x1875787987858432:12345-192.168.204.18@tcp:101:bash.0 Request processed in 1391us (1685us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788890985.289971:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 96 00010000:00010000:3.0:1788890985.292215:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.292235:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.292243:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.292250:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890985.292255:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.292264:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.292303:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c870ca00) 00010000:00010000:3.0:1788890985.292308:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890985.292315:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.292321:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f51d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.294273:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890985.294390:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858560 00000100:00100000:1.0:1788890985.294400:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858560 00000100:00100000:1.0:1788890985.294492:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00100000:1.0:1788890985.294504:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2375:x1875787987858560:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:1.0:1788890985.294522:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890985.294541:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1dcd expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788890985.294573:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788890985.294593:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=209s v=(0 0) 00010000:00010000:1.0:1788890985.294597:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788890985.294606:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dcd expref: 8 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.294627:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dcd expref: 8 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.294641:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e200, rc 0) 00000100:00100000:1.0:1788890985.294699:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987858560:12345-192.168.204.18@tcp:101:bash.0 Request processed in 197us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890985.294707:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00080000:2.0:1788890985.294791:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788890985.296614:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.296677:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858688 00000100:00100000:0.0:1788890985.296686:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858688 00000100:00100000:0.0:1788890985.296753:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 35 00000100:00100000:0.0:1788890985.296765:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:10514:x1875787987858688:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:0.0:1788890985.296784:0:11963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890985.296805:0:11963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1dd4 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.296836:0:11963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dcd expref: 9 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.296869:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890985.296874:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890985.296880:0:11963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 9 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.296914:0:11963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dcd expref: 9 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.296929:0:11963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dcd expref: 9 pid: 6662 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.296951:0:11963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f32680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11963:1875787996259456:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890985.297046:0:11963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c953c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890985.299359:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.299456:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987858816 00000100:00100000:3.0:1788890985.299517:0:11963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f32680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11963:1875787996259456:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890985.299522:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987858816 00010000:00010000:3.0:1788890985.299552:0:11963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 10 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.299565:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dcd expref: 10 pid: 6662 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.299576:0:11963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9400, rc 0) 00000100:00100000:3.0:1788890985.299634:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:10514:x1875787987858688:12345-192.168.204.18@tcp:101:bash.0 Request processed in 2871us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.299643:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 35 00000100:00100000:2.0:1788890985.299649:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:2.0:1788890985.299662:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2374:x1875787987858816:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890985.299678:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890985.299708:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dcd expref: 9 pid: 6662 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.299723:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dcd expref: 9 pid: 6662 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.299759:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000856f20ed/0x9161b78f8ec3f532 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dcd expref: 9 pid: 6662 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.299774:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890985.299779:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890985.299788:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 8 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.299799:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 8 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.299836:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 8 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.299851:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1875787996259584:192.168.204.18@tcp:105: 00000100:00100000:2.0:1788890985.299916:0:5799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d146b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788890985.303163:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1875787996259584:192.168.204.18@tcp:105: 00010000:00010000:2.0:1788890985.303210:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890985.303273:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2374:x1875787987858816:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 3614us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.303284:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:3.0:1788890985.304008:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.304148:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859072 00000100:00100000:0.0:1788890985.304156:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859072 00000100:00100000:0.0:1788890985.304368:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 25 00000100:00100000:0.0:1788890985.304378:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:10514:x1875787987859072:12345-192.168.204.18@tcp:35:bash.0 00000100:00100000:0.0:1788890985.305436:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:10514:x1875787987859072:12345-192.168.204.18@tcp:35:bash.0 Request processed in 1054us (1429us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788890985.305446:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 25 00000100:00100000:1.0:1788890985.414142:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.414292:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859200 00000100:00100000:2.0:1788890985.414302:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859200 00000100:00100000:2.0:1788890985.414429:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 97 00000100:00100000:2.0:1788890985.414453:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:10530:x1875787987859200:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890985.414488:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.414510:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ddb expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.414594:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.414609:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.414621:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890985.414660:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788890985.414663:0:11412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890985.414681:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.414705:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ddb expref: 36 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.414730:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ddb expref: 35 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.414740:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.414743:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890985.414746:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87200, rc 0) 00000100:00100000:2.0:1788890985.414807:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:10530:x1875787987859200:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 357us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.414823:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 97 00000100:00100000:1.0:1788890985.418512:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.418615:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859456 00000100:00100000:2.0:1788890985.418625:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859456 00000100:00100000:2.0:1788890985.418714:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 98 00000100:00100000:2.0:1788890985.418725:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:10530:x1875787987859456:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890985.418745:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.418764:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f54e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1de2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.418862:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.418875:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.418887:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890985.418898:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788890985.419022:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f54e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1de2 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.419052:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1de2 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.419061:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:2.0:1788890985.419064:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890985.419067:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86000, rc 0) 00000100:00100000:2.0:1788890985.419147:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:10530:x1875787987859456:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 424us (642us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788890985.419155:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 98 00000100:00100000:3.0:1788890985.422914:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.423229:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859584 00000100:00100000:2.0:1788890985.423239:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859584 00000100:00100000:2.0:1788890985.423309:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:2.0:1788890985.423320:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:2375:x1875787987859584:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890985.423347:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890985.423372:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1de2 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.423530:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00010000:00010000:2.0:1788890985.423609:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:2.0:1788890985.423614:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890985.423634:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859840 00000100:00100000:3.0:1788890985.423639:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859840 00000100:00100000:2.0:1788890985.423673:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:2375:x1875787987859584:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 352us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.423684:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 99 00000100:00100000:3.0:1788890985.423802:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:10530:x1875787987859840:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788890985.423821:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890985.423836:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1de9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.423945:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f56a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.423961:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f56a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.423971:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f56a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890985.423982:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788890985.424098:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1de9 expref: 40 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.424113:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f56a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1de9 expref: 39 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.424121:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:3.0:1788890985.424124:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788890985.424127:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edca00, rc 0) 00000100:00100000:3.0:1788890985.424250:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:10530:x1875787987859840:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 449us (720us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788890985.424257:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 99 00000100:00100000:2.0:1788890985.425838:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:1.0:1788890985.430551:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.430620:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987859968 00000100:00100000:3.0:1788890985.430630:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987859968 00000100:00100000:3.0:1788890985.430686:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 36 00000100:00100000:3.0:1788890985.430694:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2373:x1875787987859968:12345-192.168.204.18@tcp:1:lfs.0 00010000:00010000:3.0:1788890985.430732:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.430764:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 8 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.430773:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890985.430778:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788890985.430781:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.430813:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 8 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.430836:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 8 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.430851:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6662:1875787996259712:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890985.431483:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8564180 going to sleep for 11 seconds 00000100:00100000:3.0:1788890985.437354:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6662:1875787996259712:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890985.437381:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.438099:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.438227:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860096 00000100:00100000:0.0:1788890985.438235:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860096 00002000:00100000:0.0:1788890985.438282:0:6669:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9da1f4c0c380 x1875787987860096/t0(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:36/0 lens 504/0 e 0 to 0 dl 1788890996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788890985.438302:0:6669:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1f4c0c380 with x1875787987860096 ext(0->8) 00010000:00010000:0.0:1788890985.438311:0:6669:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 9 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.438326:0:6669:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 9 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788890985.438334:0:6669:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9da1f4c0c380 00000100:00100000:0.0:1788890985.438406:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:0.0:1788890985.438416:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2374:x1875787987860096:12345-192.168.204.18@tcp:4:lfs.0 00000100:00100000:0.0:1788890985.438944:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:2374:x1875787987860096:12345-192.168.204.18@tcp:4:lfs.0 Request processed in 527us (846us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788890985.438953:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 1 00002000:00100000:0.0:1788890985.438961:0:6669:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9da1f4c0c380 x1875787987860096/t4294967302(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:36/0 lens 504/448 e 0 to 0 dl 1788890996 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788890985.438969:0:6669:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1f4c0c380 with x1875787987860096 ext(0->8) 00010000:00010000:0.0:1788890985.438976:0:6669:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 11 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.438988:0:6669:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 11 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788890985.438994:0:6669:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9da1f4c0c380 00000100:00100000:1.0:1788890985.443371:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.443616:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860224 00000100:00100000:0.0:1788890985.443632:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860224 00010000:00010000:0.0:1788890985.443671:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 11 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.443775:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 49 00000100:00100000:0.0:1788890985.443787:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:2375:x1875787987860224:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890985.443803:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788890985.443822:0:5800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788890985.443825:0:5800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788890985 00002000:00010000:0.0:1788890985.443828:0:5800:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788890985 00002000:00010000:0.0:1788890985.443830:0:5800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788890985 00010000:00010000:0.0:1788890985.443837:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 11 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.443852:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 11 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.443876:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013dd044d/0x9161b78f8ec3f539 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dd4 expref: 11 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.443892:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788890985.443897:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788890985.443902:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.443911:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.443956:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890985.444019:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2375:x1875787987860224:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 234us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.444027:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 49 00010000:00010000:3.0:1788890985.444313:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.444324:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.444365:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.444373:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.444389:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.444397:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890985.444402:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.444412:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.444425:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.444433:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047612594/0x9161b78f8ec3f578 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.444498:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2373:x1875787987859968:12345-192.168.204.18@tcp:1:lfs.0 Request processed in 13803us (13954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.444507:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 36 00000100:00100000:1.0:1788890985.447570:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.447637:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860480 00000100:00100000:2.0:1788890985.447647:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860480 00000100:00100000:2.0:1788890985.447747:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 26 00000100:00100000:2.0:1788890985.447759:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8c02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:10530:x1875787987860480:12345-192.168.204.18@tcp:35:lfs.0 00000004:00010000:2.0:1788890985.447826:0:5817:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f56a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1de9 expref: 38 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890985.448107:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788890985.448155:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788890985.448539:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788890985.448593:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.448618:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dc6 expref: 42 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.448628:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.448664:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dc6 expref: 42 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.448678:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dc6 expref: 42 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.448696:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875787996259840:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890985.448779:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d146bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890985.451708:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.451768:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860608 00000100:00100000:0.0:1788890985.451778:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860608 00010000:00010000:0.0:1788890985.451821:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dc6 expref: 43 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.451913:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 50 00000100:00100000:0.0:1788890985.451925:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+43:2375:x1875787987860608:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890985.451941:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890985.451949:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dc6 expref: 43 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.451963:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dc6 expref: 43 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.451985:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:0.0:1788890985.451991:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.452000:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.452007:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.452044:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890985.452106:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+43:2375:x1875787987860608:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 184us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.452115:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 50 00010000:00010000:2.0:1788890985.452954:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dc6 expref: 42 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.452974:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875787996259840:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890985.452997:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.453006:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.453013:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890985.453129:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788890985.453622:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788890985.453790:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875787996259968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788890985.453844:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890985.453913:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c55b0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788890985.453949:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996259968 00000100:00100000:0.0:1788890985.453955:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996259968 00000100:00100000:0.0:1788890985.454029:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788890985.454038:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1875787996259968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788890985.454103:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1875787996259968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.454110:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788890985.454141:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875787996259968:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788890985.454154:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788890985.455001:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788890985.455067:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f23800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875787996260096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788890985.455106:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890985.455136:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d146bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788890985.455322:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996260096 00000100:00100000:1.0:1788890985.455329:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996260096 00000100:00100000:1.0:1788890985.455378:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788890985.455396:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788890985.455397:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5817:x1875787996260096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788890985.455407:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788890985.455589:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5817:x1875787996260096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 194us (482us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788890985.455596:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788890985.455725:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f23800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875787996260096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788890985.455773:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788890985.455809:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.455819:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.455826:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.455833:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890985.455838:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.455846:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.455861:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:3.0:1788890985.455865:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788890985.455869:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.455876:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f57f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788890985.456055:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788890985.456159:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788890985.456197:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 209305027355ns, next at 210305024349ns, rc = 0 00000001:00080000:3.0:1788890985.456205:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1788890985.456245:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:3.0:1788890985.456248:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788890985.456255:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f56a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1de9 expref: 46 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.456382:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8c02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+45:10530:x1875787987860480:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 8624us (8820us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1788890985.456390:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 26 00000020:00080000:3.0:1788890985.456394:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788890985.459670:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.459736:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860736 00000100:00100000:2.0:1788890985.459747:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860736 00000100:00100000:2.0:1788890985.459810:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 100 00000100:00100000:2.0:1788890985.459821:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+45:10530:x1875787987860736:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890985.459844:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.459883:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f586 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1df0 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.459945:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f586 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df0 expref: 46 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.459961:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f586 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df0 expref: 46 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.459978:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.459981:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890985.459985:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86a00, rc 0) 00000100:00100000:2.0:1788890985.460043:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+46:10530:x1875787987860736:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 224us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.460051:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 100 00000100:00100000:1.0:1788890985.463683:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.463826:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987860992 00000100:00100000:0.0:1788890985.463835:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987860992 00000100:00100000:0.0:1788890985.463924:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:0.0:1788890985.463934:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+46:10530:x1875787987860992:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:0.0:1788890985.464162:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+47:10530:x1875787987860992:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 229us (488us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788890985.464203:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:3.0:1788890985.507697:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.508291:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987861120 00000100:00100000:2.0:1788890985.508313:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987861120 00000100:00100000:2.0:1788890985.508387:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 101 00000100:00100000:2.0:1788890985.508400:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+47:10540:x1875787987861120:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:2.0:1788890985.508698:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.508767:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.508781:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.508797:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.508804:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.508811:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.508910:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.508919:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.508926:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890985.508970:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.508994:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509001:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509007:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509013:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.509017:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509024:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509035:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.509038:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.509042:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509048:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f58d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509060:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509065:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509071:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509082:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.509085:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509091:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509099:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890985.509101:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.509104:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509110:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f594 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509127:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509134:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509139:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509144:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.509147:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509153:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509236:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.509239:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.509242:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.509248:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f59b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.509399:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+47:10540:x1875787987861120:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 999us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.509409:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 101 00000100:00100000:1.0:1788890985.527331:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788890985.527367:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996260224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890985.527435:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890985.527758:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996260224 00000100:00100000:0.0:1788890985.527766:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996260224 00000100:00100000:0.0:1788890985.527822:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788890985.527832:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3281:x1875787996260224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788890985.527858:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788890985.527919:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3281:x1875787996260224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.527947:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788890985.528042:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996260224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890985.540643:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.544649:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987861376 00000100:00100000:3.0:1788890985.544664:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987861376 00000100:00100000:3.0:1788890985.544728:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 102 00000100:00100000:3.0:1788890985.544737:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+47:10543:x1875787987861376:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788890985.544757:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890985.544781:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f5a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1df7 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.544850:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.544864:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.544892:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.544909:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.544916:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.544923:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.545043:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.545052:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.545059:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890985.545068:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788890985.546715:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546731:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546739:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546745:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890985.546764:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546772:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546847:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:3.0:1788890985.546851:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890985.546856:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546863:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f5a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546878:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546885:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546891:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546896:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890985.546899:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546905:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546912:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1f5361400) 00010000:00010000:3.0:1788890985.546914:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890985.546923:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546929:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec3f5b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546984:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f5a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df7 expref: 50 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.546998:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df7 expref: 49 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.547006:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788890985.547008:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788890985.547011:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edda00, rc 0) 00000100:00100000:3.0:1788890985.547586:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+49:10543:x1875787987861376:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 2845us (6950us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788890985.547595:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 102 00000100:00100000:1.0:1788890985.553996:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.554121:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987861504 00000100:00100000:2.0:1788890985.554132:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987861504 00000100:00100000:2.0:1788890985.554374:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 103 00000100:00100000:2.0:1788890985.554388:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+49:10543:x1875787987861504:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:2.0:1788890985.554458:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.554477:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.554489:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.554517:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.554525:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.554548:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.554555:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.554559:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.554566:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.554578:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.554581:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788890985.554586:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.554592:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.554675:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+49:10543:x1875787987861504:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 290us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.554683:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 103 00000100:00100000:1.0:1788890985.556785:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.556850:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987861760 00000100:00100000:3.0:1788890985.556870:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987861760 00000100:00100000:3.0:1788890985.556936:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 28 00000100:00100000:3.0:1788890985.556950:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+49:10543:x1875787987861760:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890985.557291:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+50:10543:x1875787987861760:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 343us (516us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788890985.557300:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 28 00010000:00010000:2.0:1788890985.591375:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890985.607310:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.607396:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862016 00000100:00100000:2.0:1788890985.607407:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862016 00000100:00100000:2.0:1788890985.607577:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 104 00000100:00100000:2.0:1788890985.607589:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+50:10553:x1875787987862016:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890985.607615:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.607619:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788890985.607645:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ddb expref: 50 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.607681:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.607687:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890985.607700:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1dfe expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.607794:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.607807:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df7 expref: 50 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.607816:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.607851:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df7 expref: 50 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.607865:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df7 expref: 50 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.607880:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996260352:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890985.607976:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c850cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890985.613492:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996260352:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788890985.613492:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00010000:00010000:2.0:1788890985.613525:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.613839:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862144 00000100:00100000:0.0:1788890985.613846:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862144 00010000:00010000:0.0:1788890985.613881:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df7 expref: 51 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.614796:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:0.0:1788890985.614815:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+51:2375:x1875787987862144:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890985.614836:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890985.614845:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df7 expref: 51 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.614859:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df7 expref: 51 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.614881:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec3f5b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df7 expref: 51 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.614898:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:0.0:1788890985.614902:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.614912:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.614919:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.614973:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890985.615121:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+50:2375:x1875787987862144:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 312us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.615131:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 51 00010000:00010000:3.0:1788890985.615224:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.615233:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890985.615262:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788890985.615608:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f5cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dfe expref: 51 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.615626:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dfe expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.615634:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788890985.615636:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788890985.615639:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87a00, rc 0) 00000100:00100000:3.0:1788890985.615672:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+50:10553:x1875787987862016:12345-192.168.204.18@tcp:101:bash.0 Request processed in 8086us (8372us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788890985.615680:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 104 00000100:00100000:1.0:1788890985.618968:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.619078:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862400 00000100:00100000:0.0:1788890985.619089:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862400 00000100:00100000:0.0:1788890985.619223:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 105 00000100:00100000:0.0:1788890985.619235:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+50:10553:x1875787987862400:12345-192.168.204.18@tcp:36:bash.0 00010000:00010000:0.0:1788890985.619522:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.619540:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.619551:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788890985.619631:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788890985.619659:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc1f586f reply state 00000000a2ed2780 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.619668:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890985.622000:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10553:x1875787987862400:12345-192.168.204.18@tcp:36:bash.0 Request processed in 2757us (3098us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788890985.622013:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 105 00000020:00080000:0.0:1788890985.622020:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788890985.624610:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.624642:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.624649:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.624656:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.624661:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.624668:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.624687:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.624691:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.624696:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.624701:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f5e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.625728:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.626528:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862528 00000100:00100000:2.0:1788890985.626539:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862528 00000100:00100000:2.0:1788890985.626648:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 106 00000100:00100000:2.0:1788890985.626659:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:10553:x1875787987862528:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890985.626687:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.626709:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f5e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e05 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.626799:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.626828:0:11412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dfe expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.626845:0:11412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.626881:0:11412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dfe expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.626895:0:11412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dfe expref: 53 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.626910:0:11412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996260480:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890985.627011:0:11412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c850cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890985.631006:0:11412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996260480:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890985.631093:0:11412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.638550:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.639591:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862656 00000100:00100000:2.0:1788890985.639604:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862656 00010000:00010000:2.0:1788890985.639650:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dfe expref: 54 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.639709:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 52 00000100:00100000:2.0:1788890985.639719:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:2374:x1875787987862656:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890985.639736:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890985.639758:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dfe expref: 54 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.639772:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dfe expref: 54 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.639796:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1dfe expref: 54 pid: 5815 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.639814:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.639819:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.639829:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.639837:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.639926:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890985.639993:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:2374:x1875787987862656:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 274us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.640000:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 52 00010000:00010000:1.0:1788890985.640966:0:11412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.640980:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890985.641048:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788890985.641053:0:11412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788890985.641076:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.641112:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f5e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e05 expref: 53 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.641128:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e05 expref: 52 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.641136:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:1.0:1788890985.641139:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788890985.641142:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86600, rc 0) 00000100:00100000:1.0:1788890985.641386:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:10553:x1875787987862528:12345-192.168.204.18@tcp:101:bash.0 Request processed in 14728us (15662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890985.641395:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 106 00000100:00100000:1.0:1788890985.643666:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.643994:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987862912 00000100:00100000:0.0:1788890985.644003:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987862912 00000100:00100000:0.0:1788890985.644119:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 29 00000100:00100000:0.0:1788890985.644142:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:10553:x1875787987862912:12345-192.168.204.18@tcp:35:bash.0 00000100:00100000:0.0:1788890985.644435:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10553:x1875787987862912:12345-192.168.204.18@tcp:35:bash.0 Request processed in 294us (777us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788890985.644444:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 29 00000100:00100000:3.0:1788890985.695943:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.696061:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863040 00000100:00100000:2.0:1788890985.696072:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863040 00000100:00100000:2.0:1788890985.696136:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 107 00000100:00100000:2.0:1788890985.696146:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+53:10559:x1875787987863040:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890985.696206:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.696229:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e0c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.696320:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f5fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.696347:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f5fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.696361:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f5fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890985.696400:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788890985.696403:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890985.696418:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f5fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.696441:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f5f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e0c expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.696460:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f5fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e0c expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.696469:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.696472:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890985.696475:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86200, rc 0) 00000100:00100000:2.0:1788890985.696663:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10559:x1875787987863040:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 518us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.696671:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 107 00000100:00100000:1.0:1788890985.705947:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.706060:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863168 00000100:00100000:0.0:1788890985.706078:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863168 00000100:00100000:3.0:1788890985.706222:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 108 00000100:00100000:2.0:1788890985.706398:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10559:x1875787987863168:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890985.706844:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.706880:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e13 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.706955:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.706972:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.706985:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707001:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707019:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707026:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707129:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707137:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707144:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890985.707213:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788890985.707223:0:6852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890985.707244:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707257:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707266:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707272:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707279:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707285:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.707289:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707295:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707306:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.707309:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.707313:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707319:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f60b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707343:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707358:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707364:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707368:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.707370:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707375:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707382:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890985.707384:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.707387:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707392:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f612 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707426:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e13 expref: 56 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707439:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e13 expref: 55 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.707446:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.707448:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890985.707456:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87800, rc 0) 00000100:00100000:2.0:1788890985.707596:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10559:x1875787987863168:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 1362us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.709383:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 108 00000100:00100000:1.0:1788890985.710964:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.711079:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863296 00000100:00100000:2.0:1788890985.711092:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863296 00000100:00100000:2.0:1788890985.711421:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:2.0:1788890985.711431:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:2375:x1875787987863296:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890985.711450:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890985.711480:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e13 expref: 55 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.711501:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.711506:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890985.711597:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:2375:x1875787987863296:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 168us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.711603:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:3.0:1788890985.713190:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890985.713395:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863552 00000100:00100000:1.0:1788890985.713408:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863552 00000100:00100000:1.0:1788890985.713484:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 109 00000100:00100000:1.0:1788890985.713495:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10559:x1875787987863552:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:1.0:1788890985.713521:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890985.713547:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f620 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e1a expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.713710:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.713731:0:11412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e05 expref: 55 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.713741:0:11412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.713785:0:11412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e05 expref: 55 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.713802:0:11412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e05 expref: 55 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.713818:0:11412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996260608:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788890985.713932:0:11412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1dc0cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788890985.717597:0:11412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996260608:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890985.717638:0:11412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.717817:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.718418:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863680 00000100:00100000:2.0:1788890985.718430:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863680 00010000:00010000:2.0:1788890985.718485:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e05 expref: 56 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.718536:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 53 00000100:00100000:2.0:1788890985.718549:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+56:2374:x1875787987863680:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890985.718587:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890985.718595:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e05 expref: 56 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.718610:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e05 expref: 56 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.718635:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f5ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e05 expref: 56 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.718655:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.718661:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.718674:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.718683:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.718787:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890985.718868:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:2374:x1875787987863680:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 321us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.718877:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 53 00010000:00010000:1.0:1788890985.719836:0:11412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.719853:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890985.719881:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788890985.720092:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f620 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e1a expref: 56 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.720134:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e1a expref: 55 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.720143:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:1.0:1788890985.720146:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788890985.720149:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f000, rc 0) 00000100:00100000:1.0:1788890985.720244:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10559:x1875787987863552:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 6749us (7082us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788890985.720253:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 109 00000100:00100000:1.0:1788890985.726030:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.726139:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987863936 00000100:00100000:2.0:1788890985.726153:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987863936 00000100:00100000:2.0:1788890985.726271:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:2.0:1788890985.726294:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10559:x1875787987863936:12345-192.168.204.18@tcp:103:lfs.0 00010000:00010000:2.0:1788890985.726350:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890985.726383:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f586 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1df0 expref: 55 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.726405:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.726410:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890985.726484:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10559:x1875787987863936:12345-192.168.204.18@tcp:103:lfs.0 Request processed in 203us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.726493:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:1.0:1788890985.735241:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.735347:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864064 00000100:00100000:3.0:1788890985.735360:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864064 00000100:00100000:3.0:1788890985.735440:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 110 00000100:00100000:3.0:1788890985.735454:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10559:x1875787987864064:12345-192.168.204.18@tcp:58:lfs.0 00010000:00010000:3.0:1788890985.735594:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.735615:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.735628:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788890985.735908:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788890985.736026:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10559:x1875787987864064:12345-192.168.204.18@tcp:58:lfs.0 Request processed in 573us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.736035:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 110 00000100:00100000:3.0:1788890985.742013:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.742207:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864192 00000100:00100000:2.0:1788890985.742220:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864192 00000100:00100000:2.0:1788890985.742392:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 111 00000100:00100000:2.0:1788890985.742413:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:10559:x1875787987864192:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890985.742433:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.742455:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f63c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e21 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.742514:0:6852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.742525:0:6852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f63c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e21 expref: 55 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.742546:0:6852:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.742559:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f63c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e21 expref: 55 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.742587:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.742589:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890985.742593:0:6852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f63c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e21 expref: 55 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.742602:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86a00, rc 0) 00000100:00100000:2.0:1788890985.742679:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10559:x1875787987864192:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 278us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.742690:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 111 00000040:00080000:2.0:1788890985.846483:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788890985.846493:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788890985.846543:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788890985.846551:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788890985.846664:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996260736:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788890985.846780:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f81e4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788890985.850379:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996260736:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788890985.851431:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.851522:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864320 00000100:00100000:2.0:1788890985.851530:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864320 00000100:00100000:2.0:1788890985.851643:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 112 00000100:00100000:2.0:1788890985.851655:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10560:x1875787987864320:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788890985.851683:0:11412:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788890985.851783:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10560:x1875787987864320:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 130us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.851792:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 112 00000100:00100000:3.0:1788890985.854295:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.854379:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864448 00000100:00100000:0.0:1788890985.854388:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864448 00000100:00100000:0.0:1788890985.854481:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 113 00000100:00100000:0.0:1788890985.854492:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10560:x1875787987864448:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788890985.854562:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854579:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854591:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854641:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854649:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854656:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854676:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854700:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854706:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890985.854740:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788890985.854744:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890985.854755:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854765:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854772:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854779:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854785:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890985.854789:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854796:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854807:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:0.0:1788890985.854809:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890985.854813:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854827:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f643 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854840:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854846:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854852:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854856:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890985.854859:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854865:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854872:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9da1c870c700) 00010000:00010000:0.0:1788890985.854874:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890985.854877:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854883:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f64a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854895:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854900:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854910:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854915:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890985.854918:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854923:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854930:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:0.0:1788890985.854932:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890985.854935:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.854941:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.855004:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10560:x1875787987864448:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 Request processed in 514us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.855012:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 113 00000100:00100000:1.0:1788890985.861342:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.861465:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864704 00000100:00100000:2.0:1788890985.861476:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864704 00000100:00100000:2.0:1788890985.861630:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 114 00000100:00100000:2.0:1788890985.861642:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:10560:x1875787987864704:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788890985.861664:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.861685:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f658 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e28 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.861796:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.861812:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.861826:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890985.861837:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788890985.861944:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.861952:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.861958:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.861965:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.861969:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.861978:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.862004:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890985.862007:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788890985.862013:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.862019:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f65f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.862074:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f658 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e28 expref: 57 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.862085:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:2.0:1788890985.862088:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788890985.862092:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f658 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e28 expref: 57 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.862102:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86600, rc 0) 00000100:00100000:2.0:1788890985.862198:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+56:10560:x1875787987864704:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 530us (848us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788890985.862206:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 114 00000100:00100000:1.0:1788890985.869442:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.869488:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987864832 00000100:00100000:2.0:1788890985.869499:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987864832 00000100:00100000:2.0:1788890985.869570:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 115 00000100:00100000:2.0:1788890985.869580:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+56:10560:x1875787987864832:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788890985.869620:0:11412:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788890985.869832:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+56:10560:x1875787987864832:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 252us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.869856:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 115 00000100:00100000:3.0:1788890985.872305:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.872553:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865088 00000100:00100000:0.0:1788890985.872563:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865088 00000100:00100000:0.0:1788890985.872634:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 116 00000100:00100000:0.0:1788890985.872645:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+56:10560:x1875787987865088:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788890985.872664:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890985.872667:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788890985.872707:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f5fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e0c expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.872745:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:0.0:1788890985.872751:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890985.872767:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f66d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e2f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788890985.873228:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788890985.873434:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.873446:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.873455:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.873502:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f66d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e2f expref: 58 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.873517:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e2f expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.873525:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c870c700) 00010000:00010000:0.0:1788890985.873527:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788890985.873530:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8e00, rc 0) 00000100:00100000:0.0:1788890985.873593:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+57:10560:x1875787987865088:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 950us (1297us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788890985.873600:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 116 00000100:00100000:1.0:1788890985.876755:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.876813:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865344 00000100:00100000:2.0:1788890985.876824:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865344 00000100:00100000:2.0:1788890985.876888:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 117 00000100:00100000:2.0:1788890985.876898:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+57:10560:x1875787987865344:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788890985.876956:0:6852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890985.876983:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e2f expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877002:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c870c700) 00010000:00010000:2.0:1788890985.877012:0:6852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890985.877033:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877064:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877074:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877134:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877142:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877148:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877255:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877262:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877268:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877274:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.877278:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877284:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877293:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:2.0:1788890985.877295:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.877299:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877304:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f682 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877312:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877318:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877322:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877347:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.877350:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877355:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877362:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb6aba162 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788890985.877364:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.877367:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.877372:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f689 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb6aba162 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.877449:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+56:10560:x1875787987865344:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 552us (758us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788890985.877456:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 117 00000100:00100000:1.0:1788890985.882727:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.882976:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865472 00000100:00100000:2.0:1788890985.882987:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865472 00000100:00100000:2.0:1788890985.883047:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 118 00000100:00100000:2.0:1788890985.883067:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+56:10560:x1875787987865472:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788890985.883088:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.883113:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f690 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e36 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.883148:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.883399:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.883422:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.883524:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e36 expref: 58 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.883542:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e36 expref: 57 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.883551:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890985.883554:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788890985.883557:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87400, rc 0) 00000100:00100000:2.0:1788890985.883666:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+57:10560:x1875787987865472:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 609us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.883673:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 118 00000100:00100000:3.0:1788890985.885837:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.886635:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865728 00000100:00100000:0.0:1788890985.886647:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865728 00000100:00100000:0.0:1788890985.886705:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 119 00000100:00100000:0.0:1788890985.886715:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2018ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+57:10560:x1875787987865728:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788890985.886796:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.886812:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.886825:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788890985.887059:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788890985.887068:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 209735899026ns, next at 210735896539ns, rc = 0 00000004:00010000:0.0:1788890985.887150:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddc7cba3 reply state 000000001ccd3201 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.887159:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890985.887289:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2018ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:10560:x1875787987865728:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 574us (1464us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788890985.887306:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 119 00010000:00010000:3.0:1788890985.889015:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.889026:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.889030:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.889035:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890985.889038:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.889043:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.889056:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:3.0:1788890985.889058:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788890985.889062:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.889069:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f69e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.889286:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.889348:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865856 00000100:00100000:2.0:1788890985.889357:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865856 00000100:00100000:2.0:1788890985.889407:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 120 00000100:00100000:2.0:1788890985.889417:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+58:10560:x1875787987865856:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788890985.889438:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890985.889453:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e3d expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.889505:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e3d expref: 59 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.889526:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e3d expref: 59 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.889546:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890985.889549:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890985.889551:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87800, rc 0) 00000100:00100000:2.0:1788890985.889597:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:10560:x1875787987865856:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 181us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.889604:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 120 00000100:00100000:1.0:1788890985.891084:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.891158:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987865984 00000100:00100000:2.0:1788890985.891165:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987865984 00000100:00100000:2.0:1788890985.891412:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:2.0:1788890985.891422:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2373:x1875787987865984:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788890985.891718:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2373:x1875787987865984:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 297us (639us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788890985.891726:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:1.0:1788890985.894277:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.894396:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987866240 00000100:00100000:3.0:1788890985.894405:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987866240 00000100:00100000:3.0:1788890985.894454:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 30 00000100:00100000:3.0:1788890985.894463:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:10560:x1875787987866240:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788890985.894713:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:10560:x1875787987866240:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 236us (434us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788890985.894721:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 30 00000100:00100000:1.0:1788890985.897526:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.897661:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987866496 00000100:00100000:2.0:1788890985.897670:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987866496 00000100:00100000:2.0:1788890985.897732:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 121 00000100:00100000:2.0:1788890985.897743:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:10560:x1875787987866496:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788890985.897862:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:10560:x1875787987866496:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 121us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.897869:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 121 00000100:00100000:3.0:1788890985.900003:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.900104:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987866624 00000100:00100000:0.0:1788890985.900112:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987866624 00000100:00100000:0.0:1788890985.900164:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 122 00000100:00100000:0.0:1788890985.900216:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:10560:x1875787987866624:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788890985.900234:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890985.900256:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f6ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.900347:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f6b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.900361:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.900372:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890985.900406:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890985.900423:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.900449:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9a00/0x9161b78f8ec3f6ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e44 expref: 62 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.900466:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e44 expref: 61 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.900475:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:0.0:1788890985.900478:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788890985.900482:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8000, rc 0) 00000100:00100000:0.0:1788890985.900785:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:10560:x1875787987866624:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 570us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.900792:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 122 00000100:00100000:1.0:1788890985.905657:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.905807:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987866752 00000100:00100000:0.0:1788890985.905817:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987866752 00000100:00100000:0.0:1788890985.905918:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 38 00000100:00100000:0.0:1788890985.905942:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987866752:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788890985.905962:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890985.905984:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e4b expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788890985.906012:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa04f6a, blocks: 0x1 00010000:00010000:0.0:1788890985.906031:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=209s v=(0 0) 00010000:00010000:0.0:1788890985.906036:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890985.906046:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e4b expref: 10 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.906064:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e4b expref: 10 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.906078:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8800, rc 0) 00000100:00100000:0.0:1788890985.906141:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2375:x1875787987866752:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 202us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.906149:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 38 00000100:00100000:1.0:1788890985.909064:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.909227:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867008 00000100:00100000:0.0:1788890985.909236:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867008 00000100:00100000:0.0:1788890985.909284:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 123 00000100:00100000:0.0:1788890985.909294:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:10560:x1875787987867008:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788890985.909400:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:10560:x1875787987867008:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890985.909407:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 123 00000100:00100000:1.0:1788890985.912644:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.912740:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867136 00000100:00100000:3.0:1788890985.912751:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867136 00000100:00100000:3.0:1788890985.912809:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:3.0:1788890985.912820:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:10560:x1875787987867136:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788890985.912838:0:11963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890985.912857:0:11963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e52 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.912889:0:11963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e4b expref: 11 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.912899:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890985.912903:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890985.912909:0:11963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 11 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.912945:0:11963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e4b expref: 11 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.912979:0:11963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e4b expref: 11 pid: 6663 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.912994:0:11963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffecb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11963:1875787996260864:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890985.913087:0:11963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cafb60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890985.915076:0:11963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffecb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11963:1875787996260864:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890985.915108:0:11963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 11 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.915131:0:11963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd400, rc 0) 00000100:00100000:3.0:1788890985.915239:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:10560:x1875787987867136:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 2420us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.915248:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:1.0:1788890985.917600:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890985.917691:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867264 00000100:00100000:2.0:1788890985.917725:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867264 00010000:00010000:2.0:1788890985.917767:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e4b expref: 11 pid: 6663 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.917808:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 54 00000100:00100000:2.0:1788890985.917820:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:2375:x1875787987867264:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890985.917840:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890985.917864:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e4b expref: 11 pid: 6663 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.917878:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e4b expref: 11 pid: 6663 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.917902:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a95e9212/0x9161b78f8ec3f6ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e4b expref: 11 pid: 6663 timeout: 309 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.917919:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890985.917924:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890985.917933:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 10 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.917943:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 10 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.917982:0:6679:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 10 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890985.918008:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6679:1875787996260992:192.168.204.18@tcp:105: 00000100:00100000:2.0:1788890985.918090:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c51ae540 going to sleep for 11 seconds 00000100:00100000:2.0:1788890985.922031:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6679:1875787996260992:192.168.204.18@tcp:105: 00010000:00010000:2.0:1788890985.922061:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890985.922118:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2375:x1875787987867264:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 4299us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.922129:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 54 00000100:00100000:1.0:1788890985.923837:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.923909:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867392 00000100:00100000:3.0:1788890985.923916:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867392 00002000:00100000:3.0:1788890985.923959:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9da1ffb31180 x1875787987867392/t0(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:36/0 lens 504/0 e 0 to 0 dl 1788890996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788890985.923969:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1ffb31180 with x1875787987867392 ext(0->12) 00002000:00010000:3.0:1788890985.923974:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1ffb31180 00000100:00100000:3.0:1788890985.924005:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:3.0:1788890985.924015:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2374:x1875787987867392:12345-192.168.204.18@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788890985.924476:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+12:2374:x1875787987867392:12345-192.168.204.18@tcp:4:lhsmtool_posix.0 Request processed in 462us (645us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788890985.924791:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 2 00002000:00100000:3.0:1788890985.924799:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9da1ffb31180 x1875787987867392/t4294967308(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:36/0 lens 504/448 e 0 to 0 dl 1788890996 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788890985.924808:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1ffb31180 with x1875787987867392 ext(0->12) 00002000:00010000:3.0:1788890985.924812:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1ffb31180 00000100:00100000:1.0:1788890985.926990:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.927086:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867520 00000100:00100000:3.0:1788890985.927095:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867520 00000100:00100000:3.0:1788890985.927153:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 124 00000100:00100000:3.0:1788890985.927164:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:10560:x1875787987867520:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788890985.955911:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1788890985.955924:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788890985.955959:0:5836:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788890985.956016:0:5836:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9da1c8ba4900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788890985.956020:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da0c1826e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9da1c8ba49c0 00000020:00080000:0.0:1788890985.956024:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1f4e42000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9da0c3a57c00 00000001:00080000:0.0:1788890985.956035:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788890985.956045:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788890985.956056:0:5836:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9da1d146b480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788890985.956058:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1c40cfd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9da1c8564180 00000020:00080000:0.0:1788890985.956061:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1c40cfe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9da1f4f24400 00000100:00100000:3.0:1788890985.956072:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:10560:x1875787987867520:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 Request processed in 28906us (29086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890985.956083:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 124 00000100:00100000:2.0:1788890985.956267:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996261120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788890985.956311:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890985.956357:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996261120 00000100:00100000:3.0:1788890985.956364:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996261120 00000100:00100000:2.0:1788890985.956368:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788890985.956374:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996261248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788890985.956394:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788890985.956545:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788890985.956704:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788890985.956863:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996261376:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788890985.956955:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890985.957134:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996261248 00000100:00100000:3.0:1788890985.957138:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996261248 00000100:00100000:3.0:1788890985.957186:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788890985.957195:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3279:x1875787996261120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788890985.957218:0:6662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788890985.957243:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.957265:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db1 expref: 11 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.957294:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788890985.957298:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788890985.957302:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.957342:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db1 expref: 11 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.957357:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db1 expref: 11 pid: 6664 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.957369:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffecb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996261504:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890985.957417:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cafb6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788890985.957434:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788890985.957442:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3279:x1875787996261248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788890985.957952:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788890985.957957:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788890986 00002000:00010000:3.0:1788890985.957960:0:6663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788890985.957962:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788890986 -> 1788890986 00002000:00010000:3.0:1788890985.957965:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788890985.958014:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3279:x1875787996261248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 573us (1618us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788890985.958022:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788890985.958336:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788890985.958439:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da0c1ab1880/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788890985.958446:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996261248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788890985.958500:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996261376 00000100:00100000:0.0:1788890985.958505:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996261376 00000100:00100000:0.0:1788890985.958542:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788890985.958551:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3281:x1875787996261376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788890985.958567:0:11963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788890985.958592:0:11963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa04f69, atime: 0x6aa04f69, ctime: 0x6aa04f69, blocks: 0x1 00010000:00010000:0.0:1788890985.958598:0:11963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.958610:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=209s v=(0 0) 00010000:00010000:0.0:1788890985.958613:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890985.958619:0:11963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.958633:0:11963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.958652:0:11963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.958660:0:11963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.958681:0:11963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788890985.959150:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3281:x1875787996261376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 600us (825us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788890985.959157:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1788890985.959251:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890985.959257:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.959263:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9a00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890985.959266:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.959273:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.959292:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.959297:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f6cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.959311:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890985.959312:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890985.959313:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788890985.959385:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da1ffb30e00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788890985.959393:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890985.959396:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996261376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788890985.959420:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867648 00000100:00100000:1.0:1788890985.959424:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867648 00000100:00100000:1.0:1788890985.959460:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:1.0:1788890985.959469:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f511b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+12:2375:x1875787987867648:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788890985.961606:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890985.961636:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987867776 00000100:00100000:1.0:1788890985.961643:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987867776 00010000:00010000:1.0:1788890985.961675:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db1 expref: 13 pid: 6664 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890985.961724:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 55 00000100:00100000:1.0:1788890985.961733:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:2374:x1875787987867776:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890985.961746:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890985.961752:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db1 expref: 13 pid: 6664 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.961765:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db1 expref: 13 pid: 6664 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.961789:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788890985.961793:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788890985.961805:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.961815:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.961836:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890985.961891:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:2374:x1875787987867776:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 158us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890985.961899:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 55 00010000:00010000:3.0:1788890985.962195:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3f48a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1db1 expref: 12 pid: 6664 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890985.962210:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffecb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996261504:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890985.962230:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.962241:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.962248:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.962257:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.962266:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890985.962290:0:6662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788890985.962311:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788890985.962317:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.962334:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc000 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788890985.962339:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.962347:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.962359:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.962366:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005552526c/0x9161b78f8ec3f6c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890985.962393:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890985.962395:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788890985.962397:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890985.963021:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3279:x1875787996261120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5826us (6707us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788890985.963029:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1788890985.963255:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da0c1ab2d80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788890985.963263:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996261120:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788890985.983283:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1788890985.983403:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1788890985.983410:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788890985.983418:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788890985.983422:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788890985.983591:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f511b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987867648:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 Request processed in 24116us (24192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890985.983602:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:1.0:1788890985.991432:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890985.991547:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868032 00000100:00100000:0.0:1788890985.991561:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868032 00000100:00100000:0.0:1788890985.991639:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 125 00000100:00100000:0.0:1788890985.991650:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:10560:x1875787987868032:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788890985.991708:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890985.991740:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f6b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e44 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.991760:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:0.0:1788890985.991765:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890985.991795:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.991808:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890985.991837:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890985.992076:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5a1a03f reply state 0000000006850e2a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.992085:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890985.992239:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:10560:x1875787987868032:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 590us (827us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788890985.992246:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 125 00000100:00100000:1.0:1788890985.997294:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00010000:00010000:2.0:1788890985.997324:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.997349:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.997357:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.997364:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890985.997369:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.997377:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.997428:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890985.997432:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890985.997438:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890985.997444:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f6d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890985.998120:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868160 00000100:00100000:0.0:1788890985.998132:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868160 00000100:00100000:0.0:1788890985.998233:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 44 00000100:00100000:0.0:1788890985.998244:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987868160:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788890985.998468:0:11963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788890985.998472:0:11963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788890986 -> 1788890986 00002000:00010000:0.0:1788890985.998475:0:11963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788890985 00002000:00010000:0.0:1788890985.998478:0:11963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788890986 -> 1788890986 00002000:00010000:0.0:1788890985.998480:0:11963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788890985.998536:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2375:x1875787987868160:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 294us (1254us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788890985.998545:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 44 00000100:00100000:1.0:1788890986.002346:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890986.002421:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868416 00000100:00100000:2.0:1788890986.002433:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868416 00000100:00100000:2.0:1788890986.002498:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 126 00000100:00100000:2.0:1788890986.002509:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:10560:x1875787987868416:12345-192.168.204.18@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788890986.002579:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.002598:0:11412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e36 expref: 15 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.002608:0:11412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.002644:0:11412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e36 expref: 15 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.002658:0:11412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e36 expref: 15 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890986.002673:0:11412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c1ab3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996261632:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890986.002786:0:11412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c51ae240 going to sleep for 11 seconds 00000100:00100000:2.0:1788890986.006509:0:11412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c1ab3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996261632:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788890986.006509:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00010000:00010000:2.0:1788890986.006538:0:11412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890986.006604:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868544 00000100:00100000:0.0:1788890986.006612:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868544 00010000:00010000:0.0:1788890986.006657:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e36 expref: 16 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890986.006788:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 56 00000100:00100000:0.0:1788890986.006799:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:2374:x1875787987868544:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890986.006813:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890986.006820:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e36 expref: 16 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890986.006832:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e36 expref: 16 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890986.006856:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f697 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e36 expref: 16 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890986.006872:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:0.0:1788890986.006877:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890986.006918:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890986.006926:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890986.006956:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890986.007012:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:2374:x1875787987868544:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 214us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890986.007020:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 56 00010000:00010000:1.0:1788890986.007086:0:11412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.007094:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.007127:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.007134:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.007142:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.007148:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890986.007152:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.007158:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.007165:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:1.0:1788890986.007201:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788890986.007206:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.007212:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f6dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890986.007254:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:10560:x1875787987868416:12345-192.168.204.18@tcp:55:lhsmtool_posix.0 Request processed in 4748us (4927us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788890986.007262:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 126 00000100:00100000:1.0:1788890986.010853:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890986.010909:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868672 00000100:00100000:3.0:1788890986.010919:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868672 00000100:00100000:3.0:1788890986.010991:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:3.0:1788890986.011004:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987868672:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788890986.011053:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.011076:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 7 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.011085:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890986.011090:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788890986.011095:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.011143:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 7 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.011158:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 7 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890986.011205:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffecb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996261760:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890986.011311:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cafb60c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788890986.011545:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890986.013665:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffecb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996261760:192.168.204.18@tcp:104: 00010000:00010000:1.0:1788890986.013693:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890986.014112:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890986.014225:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987868800 00000100:00100000:2.0:1788890986.014234:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987868800 00010000:00010000:2.0:1788890986.014274:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 8 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890986.014310:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 57 00000100:00100000:2.0:1788890986.014320:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987868800:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890986.014347:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890986.014371:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 8 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.014386:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 8 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.014410:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3f6c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e52 expref: 8 pid: 11963 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.014502:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890986.014507:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890986.014514:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.014543:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.014585:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890986.014623:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.014631:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.014651:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.014657:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.014671:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.014676:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edda00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788890986.014678:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.014684:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.014693:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.014698:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec3f6e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890986.014775:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987868672:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 Request processed in 3775us (3931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890986.014782:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:2.0:1788890986.015240:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987868800:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 920us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890986.015249:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 57 00000100:00100000:1.0:1788890986.017286:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890986.017356:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869056 00000100:00100000:3.0:1788890986.017365:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869056 00000100:00100000:3.0:1788890986.017457:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 127 00000100:00100000:3.0:1788890986.017467:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:10560:x1875787987869056:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788890986.017553:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.017571:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.017584:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.018011:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.018022:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e3d expref: 15 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.018030:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.018442:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e3d expref: 15 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.018460:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e3d expref: 15 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890986.018475:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996261888:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890986.018663:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cafb6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788890986.020687:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996261888:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890986.020729:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890986.024601:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890986.025003:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869184 00000100:00100000:2.0:1788890986.025014:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869184 00010000:00010000:2.0:1788890986.025056:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e3d expref: 16 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890986.025106:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 58 00000100:00100000:2.0:1788890986.025117:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:2375:x1875787987869184:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890986.025134:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890986.025141:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e3d expref: 16 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.025156:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e3d expref: 16 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.025266:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f6a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e3d expref: 16 pid: 6852 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.025280:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:2.0:1788890986.025299:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.025309:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.025317:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.025402:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890986.025462:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:2375:x1875787987869184:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 347us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890986.025469:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 58 00010000:00010000:3.0:1788890986.025514:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.025522:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788890986.026303:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788890986.026587:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788890986.026633:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788890986.026859:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5815:1875787996262016:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788890986.026918:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890986.026999:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cafb60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890986.027045:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996262016 00000100:00100000:2.0:1788890986.027052:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996262016 00000100:00100000:2.0:1788890986.027151:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788890986.027160:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1875787996262016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788890986.027268:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1875787996262016:12345-0@lo:1000:mdt00_001.0 Request processed in 109us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890986.027275:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788890986.027355:0:5815:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788890986.027360:0:5815:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788890986.027378:0:5815:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da0c1ab1880, transno 4294967309 00000100:00100000:3.0:1788890986.027402:0:5815:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9da0c1ab2d80 x1875787996261120/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788891001 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890986.027415:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5815:1875787996262016:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788890986.027847:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788890986.027905:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5815:1875787996262144:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788890986.027943:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890986.028203:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cafb6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788890986.028273:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996262144 00000100:00100000:1.0:1788890986.028278:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996262144 00000100:00100000:1.0:1788890986.028321:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788890986.028339:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5815:x1875787996262144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788890986.028525:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5815:x1875787996262144:12345-0@lo:1000:mdt00_001.0 Request processed in 188us (580us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788890986.028532:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788890986.028604:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5815:1875787996262144:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788890986.028644:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028653:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028661:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028668:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edce00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890986.028673:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028681:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028762:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeef00) 00010000:00010000:3.0:1788890986.028766:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788890986.028771:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028778:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f6f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028817:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028824:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028828:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028842:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edca00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890986.028845:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028851:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028859:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788890986.028861:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788890986.028868:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f63c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e21 expref: 18 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028880:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f63c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e21 expref: 18 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028888:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f63c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e21 expref: 18 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.028918:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f63c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e21 expref: 18 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890986.028932:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996262272:192.168.204.18@tcp:105: 00000100:00100000:3.0:1788890986.029002:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cafb6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788890986.032692:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffecbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996262272:192.168.204.18@tcp:105: 00010000:00010000:3.0:1788890986.032727:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032758:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec3f635 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032792:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032805:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032816:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032827:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032834:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032840:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032846:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890986.032850:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032858:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032869:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788890986.032872:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890986.032876:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032888:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f6f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032900:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032907:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032912:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032917:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890986.032919:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032924:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032932:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788890986.032934:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788890986.032937:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.032941:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f6eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890986.033208:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:10560:x1875787987869056:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 15741us (15926us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788890986.033218:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 127 00000020:00080000:3.0:1788890986.033230:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788890986.033415:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788890986.033420:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788890986.033939:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788890986.033948:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788890986.034631:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890986.034695:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869312 00000100:00100000:3.0:1788890986.034705:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869312 00000100:00100000:3.0:1788890986.034760:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 31 00000100:00100000:3.0:1788890986.034770:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:10559:x1875787987869312:12345-192.168.204.18@tcp:49:lfs.0 00000100:00100000:3.0:1788890986.035201:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:10559:x1875787987869312:12345-192.168.204.18@tcp:49:lfs.0 Request processed in 431us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890986.035210:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 31 00000100:00100000:0.0:1788890986.037380:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890986.037422:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890986.037510:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869824 00000100:00100000:1.0:1788890986.037520:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869824 00000100:00100000:1.0:1788890986.037577:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 128 00000100:00100000:1.0:1788890986.037587:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:10559:x1875787987869824:12345-192.168.204.18@tcp:58:lfs.0 00000100:00100000:2.0:1788890986.037737:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869568 00000100:00100000:2.0:1788890986.037742:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869568 00000100:00100000:2.0:1788890986.037777:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 32 00000100:00100000:2.0:1788890986.037793:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8c02050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:10560:x1875787987869568:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1788890986.038013:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788890986.038125:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:10559:x1875787987869824:12345-192.168.204.18@tcp:58:lfs.0 Request processed in 538us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890986.038133:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 128 00000004:00080000:2.0:1788890986.038458:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788890986.038592:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788890986.038644:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.038661:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.038673:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.038681:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.038688:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.038694:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890986.038711:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788890986.038775:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8c02050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:10560:x1875787987869568:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 990us (1401us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788890986.038782:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 32 00000020:00080000:2.0:1788890986.038786:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788890986.039276:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890986.039285:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.039294:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890986.039299:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.039308:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.039333:0:6678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:3.0:1788890986.039336:0:6678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788890986.039341:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.039347:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f700 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.039367:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890986.039369:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890986.039370:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890986.059559:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890986.059654:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987869952 00000100:00100000:1.0:1788890986.059665:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987869952 00000100:00100000:1.0:1788890986.059761:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 129 00000100:00100000:1.0:1788890986.059771:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:10562:x1875787987869952:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:1.0:1788890986.059807:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890986.059830:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f707 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e59 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.059902:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.059916:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.059929:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.059966:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.059974:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.059981:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.060272:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.060284:0:11412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e1a expref: 21 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.060293:0:11412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.060341:0:11412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e1a expref: 21 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.060354:0:11412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e1a expref: 21 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890986.060368:0:11412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffb30700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996262400:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788890986.060469:0:11412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788890986.062451:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890986.062538:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870208 00000100:00100000:3.0:1788890986.062559:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870208 00000100:00100000:3.0:1788890986.062645:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:3.0:1788890986.062654:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:5601:x1875787987870208:12345-192.168.204.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788890986.062739:0:11412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffb30700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996262400:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890986.062766:0:11412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890986.062930:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:5601:x1875787987870208:12345-192.168.204.18@tcp:35:ldlm_bl.0 Request processed in 276us (483us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788890986.062938:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:2.0:1788890986.066521:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890986.066621:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870336 00000100:00100000:1.0:1788890986.066641:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870336 00010000:00010000:1.0:1788890986.066678:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e1a expref: 23 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890986.066754:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 59 00000100:00100000:1.0:1788890986.066765:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:2374:x1875787987870336:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890986.066779:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890986.066796:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e1a expref: 23 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.066809:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e1a expref: 23 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.066830:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f627 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e1a expref: 23 pid: 11412 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.066846:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:1.0:1788890986.066850:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.066858:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.066865:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890986.066904:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890986.066958:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:2374:x1875787987870336:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 195us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890986.066975:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 59 00010000:00010000:3.0:1788890986.067157:0:11412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067211:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890986.067298:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788890986.067304:0:11412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788890986.067338:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067352:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067361:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067368:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067374:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067380:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890986.067384:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067398:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067408:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:3.0:1788890986.067411:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890986.067416:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067422:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3f70e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067433:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067439:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067445:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067450:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fe00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890986.067453:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067459:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067466:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9da1c32fc500) 00010000:00010000:3.0:1788890986.067469:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890986.067472:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067488:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3f715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067523:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3f707 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e59 expref: 22 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067536:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e59 expref: 21 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890986.067543:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788890986.067545:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788890986.067548:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e200, rc 0) 00000100:00100000:3.0:1788890986.067580:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:10562:x1875787987869952:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 7811us (8033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890986.067587:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 129 00010000:00010000:2.0:1788890986.614520:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788890986.628037:0:12037:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788890986.628046:0:12037:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788890986.628085:0:12037:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788890986.628090:0:12037:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788890986.731956:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890986.732008:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890986.732042:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890986.732064:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870464 00000100:00100000:3.0:1788890986.732075:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870464 00000100:00100000:2.0:1788890986.732091:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890986.732131:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890986.732140:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 268 00000100:00100000:3.0:1788890986.732155:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2375:x1875787987870464:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890986.732161:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870720 00000100:00100000:3.0:1788890986.732262:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2375:x1875787987870464:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 110us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890986.732280:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 268 00000100:00100000:2.0:1788890986.732339:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870976 00000100:00100000:3.0:1788890986.732344:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870848 00000100:00100000:2.0:1788890986.732344:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870976 00000100:00100000:3.0:1788890986.732351:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870848 00000100:00100000:3.0:1788890986.732392:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 59 00000100:00100000:2.0:1788890986.732399:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987870592 00000100:00100000:3.0:1788890986.732405:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2374:x1875787987870848:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890986.732405:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870592 00000100:00100000:2.0:1788890986.732437:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 100 00000100:00100000:3.0:1788890986.732444:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2374:x1875787987870848:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 42us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890986.732450:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2375:x1875787987870976:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788890986.732458:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 59 00000100:00100000:3.0:1788890986.732484:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 101 00000100:00100000:2.0:1788890986.732491:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2375:x1875787987870976:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 44us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890986.732511:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:2374:x1875787987870592:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788890986.732511:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 100 00000100:00080000:2.0:1788890986.732541:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890986.732554:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:2374:x1875787987870592:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 49us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890986.732665:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987870720 00000100:00100000:3.0:1788890986.732740:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 101 00000100:00100000:0.0:1788890986.732835:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:0.0:1788890986.732847:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987870720:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890986.732881:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987870720:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 38us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890986.732889:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 60 00000040:00080000:0.0:1788890987.063159:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788890987.063253:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788890987.063299:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788890987.063317:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788890987.063454:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f32300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996262528:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788890987.063617:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c58d1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788890987.068475:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890987.068865:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f32300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996262528:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788890987.069926:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987871104 00000100:00100000:3.0:1788890987.069936:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987871104 00000100:00100000:3.0:1788890987.070053:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 130 00000100:00100000:3.0:1788890987.070062:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:10574:x1875787987871104:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788890987.070092:0:11412:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788890987.070245:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:10574:x1875787987871104:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 184us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890987.070253:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 130 00000100:00080000:2.0:1788890987.071152:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890987.077133:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890987.077768:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987871360 00000100:00100000:3.0:1788890987.077780:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987871360 00000100:00100000:3.0:1788890987.077848:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 131 00000100:00100000:3.0:1788890987.077870:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:10574:x1875787987871360:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788890987.077892:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890987.077927:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f723 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e60 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890987.078034:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f72a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890987.078325:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f72a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890987.078339:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f72a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890987.078351:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788890987.078493:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f723 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e60 expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890987.078512:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f72a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e60 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890987.078674:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788890987.078679:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788890987.078683:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc000, rc 0) 00000100:00100000:3.0:1788890987.078766:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:10574:x1875787987871360:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 909us (1644us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788890987.078774:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 131 00000100:00100000:3.0:1788890987.084802:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890987.085426:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987871488 00000100:00100000:1.0:1788890987.085436:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987871488 00000100:00100000:1.0:1788890987.085494:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:1.0:1788890987.085503:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f16450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:2372:x1875787987871488:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890987.085518:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890987.085540:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3f72a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e60 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890987.085556:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:1.0:1788890987.085560:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890987.085650:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f16450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:2372:x1875787987871488:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 147us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890987.085657:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:2.0:1788890987.091896:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890987.091955:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987871744 00000100:00100000:0.0:1788890987.091965:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987871744 00000100:00100000:0.0:1788890987.092067:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 132 00000100:00100000:0.0:1788890987.092076:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:10574:x1875787987871744:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788890987.092152:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890987.092197:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890987.092228:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890987.092450:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890987.092458:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890987.092465:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890987.092471:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890987.092477:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890987.092485:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890987.092497:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:0.0:1788890987.092501:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788890987.092505:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890987.092511:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f738 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890987.092677:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:10574:x1875787987871744:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 600us (790us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788890987.092685:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 132 00000040:00080000:2.0:1788890987.092870:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788890987.092874:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788890987.093355:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788890987.093364:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788890987.094823:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890987.094882:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872000 00000100:00100000:1.0:1788890987.094891:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872000 00000100:00100000:3.0:1788890987.094999:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00100000:3.0:1788890987.095011:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:10574:x1875787987872000:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788890987.095555:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:10574:x1875787987872000:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 544us (736us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788890987.095562:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 34 00010000:00010000:1.0:1788890987.638540:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788890988.220307:0:12089:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788890988.220315:0:12089:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788890988.220356:0:12089:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788890988.220363:0:12089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788890988.317363:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890988.317500:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872256 00000100:00100000:2.0:1788890988.317618:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872256 00000100:00100000:2.0:1788890988.317750:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 133 00000100:00100000:2.0:1788890988.317761:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:10594:x1875787987872256:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890988.317785:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890988.317807:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f73f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e67 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890988.317926:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f746 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890988.317940:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890988.317953:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890988.317964:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788890988.318088:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f73f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e67 expref: 27 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890988.318104:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e67 expref: 26 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890988.318112:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788890988.318115:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788890988.318119:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86000, rc 0) 00000100:00100000:2.0:1788890988.318198:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:10594:x1875787987872256:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 438us (845us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788890988.318207:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 133 00000100:00100000:2.0:1788890988.321534:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890988.321616:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872384 00000100:00100000:0.0:1788890988.321625:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872384 00000100:00100000:0.0:1788890988.321678:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 134 00000100:00100000:0.0:1788890988.321689:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:10594:x1875787987872384:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:0.0:1788890988.321751:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890988.321766:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890988.321776:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890988.321800:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890988.321807:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890988.321814:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890988.321820:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890988.321823:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890988.321831:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890988.321842:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:0.0:1788890988.321845:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788890988.321849:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890988.321861:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890988.321932:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:10594:x1875787987872384:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 245us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890988.321939:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 134 00000100:00100000:0.0:1788890988.388330:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890988.388649:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872512 00000100:00100000:3.0:1788890988.388660:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872512 00000100:00100000:3.0:1788890988.388805:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 46 00000100:00100000:3.0:1788890988.388815:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2374:x1875787987872512:12345-192.168.204.18@tcp:101:cat.0 00010000:00010000:3.0:1788890988.388833:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890988.388854:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec3f75b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e6e expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890988.388883:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa04f6a, atime: 0x6aa04f69, ctime: 0x6aa04f6a, blocks: 0xb 00010000:00010000:3.0:1788890988.388918:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=212s v=(0 0) 00010000:00010000:3.0:1788890988.388924:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890988.388934:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec3f75b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e6e expref: 7 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890988.388953:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec3f75b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e6e expref: 7 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890988.388966:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edca00, rc 0) 00000100:00100000:3.0:1788890988.389024:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987872512:12345-192.168.204.18@tcp:101:cat.0 Request processed in 211us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890988.389031:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 46 00000100:00080000:2.0:1788890988.389120:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890988.393758:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890988.393959:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872640 00000100:00100000:0.0:1788890988.393968:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872640 00002000:00100000:0.0:1788890988.394010:0:6669:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9da1ffb33100 x1875787987872640/t0(0) o3->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:39/0 lens 488/0 e 0 to 0 dl 1788890999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788890988.394017:0:6669:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1ffb33100 with x1875787987872640 ext(0->4095) 00002000:00010000:0.0:1788890988.394022:0:6669:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1ffb33100 00000100:00100000:0.0:1788890988.394053:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:0.0:1788890988.394060:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2375:x1875787987872640:12345-192.168.204.18@tcp:3:cat.0 00000100:00100000:1.0:1788890988.394326:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2375:x1875787987872640:12345-192.168.204.18@tcp:3:cat.0 Request processed in 264us (576us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788890988.394338:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 3 00002000:00100000:1.0:1788890988.394360:0:6669:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9da1ffb33100 x1875787987872640/t0(0) o3->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:39/0 lens 488/4536 e 0 to 0 dl 1788890999 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788890988.394367:0:6669:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1ffb33100 with x1875787987872640 ext(0->4095) 00002000:00010000:1.0:1788890988.394371:0:6669:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1ffb33100 00000100:00100000:0.0:1788890988.599696:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788890988.599723:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996262656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788890988.599805:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890988.599929:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996262656 00000100:00100000:3.0:1788890988.599949:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996262656 00000100:00100000:3.0:1788890988.600019:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788890988.600031:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875787996262656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890988.600071:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890988.600130:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875787996262656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890988.600138:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788890988.600187:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890988.600227:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996262656:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788890988.638135:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788890988.638155:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1788890988.662316:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890989.686399:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890990.136200:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996262912:0@lo:400:kworker.0 00000100:00100000:3.0:1788890990.136255:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996263040:0@lo:400:kworker.0 00000100:00100000:0.0:1788890990.136282:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890990.136308:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996262912 00000100:00100000:3.0:1788890990.136316:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996262912 00000100:00100000:0.0:1788890990.136356:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996263424:0@lo:400:kworker.0 00000100:00100000:0.0:1788890990.136383:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890990.136413:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788890990.136432:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996262784:0@lo:400:kworker.0 00000100:00100000:0.0:1788890990.136459:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890990.136480:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996263296:0@lo:400:kworker.0 00000100:00100000:3.0:1788890990.136484:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788890990.136493:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996262912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890990.136500:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890990.136523:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996262784 00000100:00100000:0.0:1788890990.136527:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996262784 00000100:00100000:3.0:1788890990.136542:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996262912:12345-0@lo:400:kworker.0 Request processed in 51us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890990.136549:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788890990.136553:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788890990.136558:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996262784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890990.136563:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996263296 00000100:00100000:3.0:1788890990.136565:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996263296 00000100:00100000:0.0:1788890990.136586:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996262784:12345-0@lo:400:kworker.0 Request processed in 28us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890990.136592:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788890990.136605:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788890990.136611:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996263296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890990.136625:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996263168:0@lo:400:kworker.0 00000100:00100000:0.0:1788890990.136634:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890990.136640:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996263296:12345-0@lo:400:kworker.0 Request processed in 30us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890990.136646:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788890990.136656:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996263040 00000100:00100000:3.0:1788890990.136665:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996263040 00000100:00100000:2.0:1788890990.136670:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890990.136681:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996262784:0@lo:400:kworker.0 00000100:00100000:3.0:1788890990.136694:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788890990.136697:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996263296:0@lo:400:kworker.0 00000100:00100000:3.0:1788890990.136701:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996263040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890990.136710:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996262912:0@lo:400:kworker.0 00000100:00100000:2.0:1788890990.136733:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996263424 00000100:00100000:2.0:1788890990.136740:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996263424 00000100:00100000:0.0:1788890990.136754:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996263040:0@lo:400:kworker.0 00000100:00100000:3.0:1788890990.136755:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996263040:12345-0@lo:400:kworker.0 Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890990.136762:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788890990.136776:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996263168 00000100:00100000:2.0:1788890990.136781:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996263168 00000100:00100000:3.0:1788890990.136785:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788890990.136795:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996263424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890990.136817:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788890990.136828:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1875787996263168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890990.136841:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996263424:12345-0@lo:400:kworker.0 Request processed in 46us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890990.136848:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788890990.136874:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1875787996263168:12345-0@lo:400:kworker.0 Request processed in 48us (206us total) trans 0 rc 0/0 00000100:00080000:3.0:1788890990.136879:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890990.136883:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788890990.136885:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788890990.136890:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890990.136917:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788890990.136923:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000100:00100000:2.0:1788890990.136927:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996263168:0@lo:400:kworker.0 00000004:00080000:0.0:1788890990.136942:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da1f5336a00, transno 4294967301 00000004:00080000:0.0:1788890990.136961:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788890990.136975:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da1ffb30e00, transno 4294967304 00000100:00100000:0.0:1788890990.136980:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996263424:0@lo:400:kworker.0 00000040:00080000:0.0:1788890990.203476:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788890990.203486:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788890990.203541:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788890990.203557:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788890990.646770:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996263552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788890990.646840:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890990.646963:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996263552 00000100:00100000:3.0:1788890990.646972:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996263552 00000100:00100000:3.0:1788890990.647026:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788890990.647037:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996263552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788890990.647080:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890990.647143:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996263552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890990.647256:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788890990.647338:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996263552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788890990.710301:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788890991.218471:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788890991.218488:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788890991.224717:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1788890991.224737:0:5836:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1788890991.224759:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788890991.224781:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1788890991.224788:0:5836:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9da1cafb60c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788890991.224793:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1d07f7200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9da1cafb6b40 00000020:00080000:2.0:1788890991.224796:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1788890991.224796:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1d07f7400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9da1dfce3400 00000020:00080000:2.0:1788890991.224824:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788890991.225012:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788890991.450630:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890991.450770:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987872768 00000100:00100000:2.0:1788890991.450780:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987872768 00000100:00100000:2.0:1788890991.450906:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 135 00000100:00100000:2.0:1788890991.450917:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:10248:x1875787987872768:12345-192.168.204.18@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788890991.452275:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:10248:x1875787987872768:12345-192.168.204.18@tcp:60:lhsmtool_posix.0 Request processed in 1354us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890991.452287:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 135 00000100:00080000:3.0:1788890991.454356:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788890991.454803:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890991.455041:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873024 00000100:00100000:2.0:1788890991.455050:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873024 00000100:00100000:2.0:1788890991.455110:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 35 00000100:00100000:2.0:1788890991.455121:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:10248:x1875787987873024:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788890991.455480:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:10248:x1875787987873024:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 361us (683us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788890991.455488:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 35 00000100:00100000:1.0:1788890991.721959:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890991.722261:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873152 00000100:00100000:3.0:1788890991.722272:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873152 00000100:00080000:0.0:1788890991.722337:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890991.722356:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 136 00000100:00100000:3.0:1788890991.722370:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:11046:x1875787987873152:12345-192.168.204.18@tcp:101:lsof.0 00010000:00010000:3.0:1788890991.722407:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890991.722429:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f762 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890991.722495:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890991.722510:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890991.722523:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890991.722556:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788890991.722560:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788890991.722600:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890991.722625:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f762 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e75 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890991.722643:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e75 expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890991.722652:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:3.0:1788890991.722655:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788890991.722658:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd800, rc 0) 00000100:00100000:3.0:1788890991.722727:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:11046:x1875787987873152:12345-192.168.204.18@tcp:101:lsof.0 Request processed in 360us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890991.722735:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 136 00010000:00010000:3.0:1788890991.734669:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890991.852819:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890991.852931:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890991.852975:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890991.853153:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873536 00000100:00100000:2.0:1788890991.853165:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873536 00000100:00100000:0.0:1788890991.853195:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873408 00000100:00100000:0.0:1788890991.853201:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873408 00000100:00100000:0.0:1788890991.853285:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 63 00000100:00100000:0.0:1788890991.853295:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2373:x1875787987873408:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890991.853369:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2373:x1875787987873408:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 76us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890991.853377:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 63 00000100:00100000:3.0:1788890991.853798:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873280 00000100:00100000:3.0:1788890991.853804:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873280 00000100:00100000:3.0:1788890991.853843:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 270 00000100:00100000:3.0:1788890991.853851:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987873280:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788890991.853889:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987873280:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 39us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890991.853897:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 270 00000100:00080000:1.0:1788890991.854339:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890991.854585:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 64 00000100:00100000:2.0:1788890991.854596:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987873536:12345-192.168.204.18@tcp:400:kworker.0 00000100:00080000:1.0:1788890991.854647:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788890991.854651:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987873536:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 56us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890991.854661:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 64 00010000:00010000:2.0:1788890992.758641:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788890993.563406:0:12289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:09:53 (1788890993) 00000100:00100000:1.0:1788890993.720383:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996263680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788890993.720454:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890993.722080:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996263680 00000100:00100000:3.0:1788890993.722093:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996263680 00000100:00080000:1.0:1788890993.722201:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788890993.722206:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788890993.722218:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996263680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788890993.722265:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788890993.722345:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996263680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890993.722352:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788890993.722594:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788890993.722601:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da0c1ab2d80, transno 4294967310 00000004:00080000:1.0:1788890993.722620:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788890993.722648:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996263680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788890993.782422:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890994.417052:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890994.417142:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873792 00000100:00100000:3.0:1788890994.417153:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873792 00000100:00100000:3.0:1788890994.417291:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 137 00000100:00100000:3.0:1788890994.417302:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:11310:x1875787987873792:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788890994.417327:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788890994.417341:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788890994.417350:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f770 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e7c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417425:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417449:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417463:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417480:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417487:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417494:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417728:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3f785 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417737:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3f785 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417745:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3f785 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890994.417754:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788890994.417839:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417847:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417853:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417865:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4eddc00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890994.417869:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417875:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417889:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9da1c32fc000) 00010000:00010000:3.0:1788890994.417892:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890994.417896:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417902:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f777 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417915:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417921:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417927:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417932:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890994.417935:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417940:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417958:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9da1f5361600) 00010000:00010000:3.0:1788890994.417961:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890994.417964:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.417970:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3f77e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.418379:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f770 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e7c expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.418394:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3f785 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e7c expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890994.418402:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:3.0:1788890994.418404:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890994.418407:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd000, rc 0) 00000100:00100000:3.0:1788890994.418476:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:11310:x1875787987873792:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 1176us (1433us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788890994.418484:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 137 00000100:00100000:0.0:1788890994.424713:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890994.424764:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890994.424812:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987873920 00000100:00100000:2.0:1788890994.424822:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987873920 00000100:00100000:2.0:1788890994.424886:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 138 00000100:00100000:2.0:1788890994.424896:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:11310:x1875787987873920:12345-192.168.204.18@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788890994.425005:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:11310:x1875787987873920:12345-192.168.204.18@tcp:59:lhsmtool_posix.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890994.425012:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 138 00000100:00100000:1.0:1788890994.425077:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874048 00000100:00100000:1.0:1788890994.425081:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874048 00000100:00100000:1.0:1788890994.425124:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:1.0:1788890994.425130:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:2373:x1875787987874048:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890994.425153:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890994.425208:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3f785 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e7c expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890994.425227:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:1.0:1788890994.425231:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890994.425252:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:2373:x1875787987874048:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 122us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890994.425258:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00010000:00010000:3.0:1788890994.809108:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788890995.255552:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996263808:0@lo:400:kworker.0 00000100:00100000:0.0:1788890995.255627:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890995.255649:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996263936:0@lo:400:kworker.0 00000100:00100000:3.0:1788890995.255693:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890995.255748:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c328a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996264448:0@lo:400:kworker.0 00000100:00100000:3.0:1788890995.255922:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890995.255973:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996263936 00000100:00100000:3.0:1788890995.255989:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996263936 00000100:00100000:3.0:1788890995.256041:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788890995.256052:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996263936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890995.256131:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996263936:12345-0@lo:400:kworker.0 Request processed in 81us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890995.256138:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788890995.256192:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996264448 00000100:00100000:3.0:1788890995.256197:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996264448 00000100:00100000:3.0:1788890995.256238:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788890995.256246:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996264448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788890995.256286:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996264448:12345-0@lo:400:kworker.0 Request processed in 42us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890995.256292:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788890995.256313:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788890995.256348:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996263936:0@lo:400:kworker.0 00000100:00100000:3.0:1788890995.256360:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c328a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996264448:0@lo:400:kworker.0 00000100:00100000:0.0:1788890995.257218:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c328b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996264320:0@lo:400:kworker.0 00000100:00100000:0.0:1788890995.257265:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890995.257306:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996264064:0@lo:400:kworker.0 00000100:00100000:2.0:1788890995.257322:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996264320 00000100:00100000:2.0:1788890995.257328:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996264320 00000100:00100000:2.0:1788890995.257371:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788890995.257384:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996264320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890995.257409:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890995.257436:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788890995.257444:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996264320:12345-0@lo:400:kworker.0 Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890995.257446:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996264192:0@lo:400:kworker.0 00000100:00100000:2.0:1788890995.257458:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788890995.257481:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890995.257483:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996264064 00000100:00100000:2.0:1788890995.257488:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996264064 00000100:00100000:2.0:1788890995.257519:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788890995.257527:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996264064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890995.257556:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996264192 00000100:00100000:0.0:1788890995.257561:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996264192 00000100:00100000:2.0:1788890995.257567:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996264064:12345-0@lo:400:kworker.0 Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890995.257573:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788890995.257597:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996263808 00000100:00100000:2.0:1788890995.257602:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996263808 00000100:00100000:0.0:1788890995.257606:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788890995.257623:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996264192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788890995.257631:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788890995.257640:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3279:x1875787996263808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788890995.257678:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996264192:12345-0@lo:400:kworker.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890995.257686:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3279:x1875787996263808:12345-0@lo:400:kworker.0 Request processed in 47us (2058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890995.257687:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788890995.257698:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788890995.257751:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996263808:0@lo:400:kworker.0 00000100:00100000:2.0:1788890995.257763:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c328b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996264320:0@lo:400:kworker.0 00000100:00080000:3.0:1788890995.258227:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788890995.258234:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890995.258283:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996264192:0@lo:400:kworker.0 00000100:00100000:3.0:1788890995.258300:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da2018fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996264064:0@lo:400:kworker.0 00000040:00080000:0.0:1788890995.318413:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788890995.318424:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788890995.318929:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788890995.318938:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788890995.609383:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890995.609495:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874176 00000100:00100000:2.0:1788890995.609508:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874176 00000100:00100000:2.0:1788890995.609608:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 139 00000100:00100000:2.0:1788890995.609621:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:11353:x1875787987874176:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890995.609641:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890995.609663:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f793 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e83 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.609729:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.609760:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.609777:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.609795:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.609803:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.609810:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610019:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610027:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610034:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610040:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890995.610045:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610053:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610066:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:2.0:1788890995.610076:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890995.610082:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610089:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610102:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610108:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610115:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610120:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890995.610123:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610129:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610147:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9da1c2aee600) 00010000:00010000:2.0:1788890995.610150:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890995.610153:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610159:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610221:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f793 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e83 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610245:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:2.0:1788890995.610247:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890995.610251:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f793 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e83 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.610262:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86c00, rc 0) 00000100:00100000:2.0:1788890995.610322:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:11353:x1875787987874176:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 704us (951us total) trans 0 rc 301/301 00000100:00100000:2.0:1788890995.610329:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 139 00000100:00100000:0.0:1788890995.629987:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890995.630072:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874432 00000100:00100000:2.0:1788890995.630082:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874432 00000100:00100000:2.0:1788890995.630157:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 140 00000100:00100000:2.0:1788890995.630204:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:11353:x1875787987874432:12345-192.168.204.18@tcp:36:lfs.0 00010000:00010000:2.0:1788890995.630277:0:11412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890995.630309:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3f111 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cbc expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.630332:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:2.0:1788890995.630337:0:11412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890995.630564:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.630579:0:11412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e75 expref: 5 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.630587:0:11412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.630627:0:11412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e75 expref: 5 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.630642:0:11412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e75 expref: 5 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890995.630657:0:11412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb28380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996264576:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890995.630762:0:11412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890995.639863:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890995.639918:0:11412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb28380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996264576:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890995.639944:0:11412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890995.639974:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874560 00000100:00100000:3.0:1788890995.639994:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874560 00010000:00010000:3.0:1788890995.640053:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e75 expref: 6 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890995.640085:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:3.0:1788890995.640101:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:2374:x1875787987874560:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890995.640116:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890995.640123:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e75 expref: 6 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640147:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e75 expref: 6 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640189:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3f769 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e75 expref: 6 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640201:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:3.0:1788890995.640206:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640214:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640221:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640238:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890995.640286:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2374:x1875787987874560:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 186us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890995.640301:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 60 00010000:00010000:3.0:1788890995.640749:0:11412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640757:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640781:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640791:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.640798:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890995.641990:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788890995.642005:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.642014:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.642021:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.642027:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890995.642031:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.642039:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.642059:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c32fc700) 00010000:00010000:3.0:1788890995.642062:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890995.642068:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.642074:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f7a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788890995.642091:0:11412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0f7dbe9 reply state 0000000007fcabf1 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890995.642100:0:11412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788890995.642210:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:11353:x1875787987874432:12345-192.168.204.18@tcp:36:lfs.0 Request processed in 12041us (12231us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788890995.642219:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 140 00000100:00080000:1.0:1788890995.642793:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788890995.646603:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.646620:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.646628:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.646635:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edce00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890995.646640:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.646649:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.646666:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9da1f5361600) 00010000:00010000:1.0:1788890995.646669:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890995.646680:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.646687:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edce00/0x9161b78f8ec3f7af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890995.720241:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890995.721733:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874688 00000100:00100000:0.0:1788890995.721747:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874688 00000100:00100000:0.0:1788890995.721821:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 141 00000100:00100000:0.0:1788890995.721833:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+15:11361:x1875787987874688:12345-192.168.204.18@tcp:101:lctl.0 00010000:00010000:0.0:1788890995.721857:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890995.721882:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f7b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e8a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.721947:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f7bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.721961:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.721986:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890995.722024:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788890995.722029:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890995.722053:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.722077:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f7b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e8a expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.722094:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f7bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e8a expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.722103:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:0.0:1788890995.722106:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788890995.722110:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9400, rc 0) 00000100:00100000:0.0:1788890995.722377:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:11361:x1875787987874688:12345-192.168.204.18@tcp:101:lctl.0 Request processed in 546us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890995.722386:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 141 00000100:00100000:3.0:1788890995.762837:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890995.763512:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987874816 00000100:00100000:2.0:1788890995.763523:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987874816 00000100:00100000:2.0:1788890995.763627:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 142 00000100:00100000:2.0:1788890995.763639:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+16:11367:x1875787987874816:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890995.763661:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890995.763680:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e91 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.763762:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.763777:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.763788:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.763805:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.763832:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.763839:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.763936:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f7d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.763943:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.763950:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890995.763977:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788890995.763981:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890995.763999:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764010:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764016:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764023:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764029:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890995.764034:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764049:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764062:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:2.0:1788890995.764065:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890995.764071:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764076:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f7cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764089:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764094:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764099:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764104:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890995.764106:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764111:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764117:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9da1c2aee400) 00010000:00010000:2.0:1788890995.764120:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890995.764122:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764156:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f7d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764233:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f7c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e91 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764248:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e91 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.764255:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890995.764257:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788890995.764259:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87c00, rc 0) 00000100:00100000:2.0:1788890995.764562:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:11367:x1875787987874816:12345-192.168.204.18@tcp:101:bash.0 Request processed in 925us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890995.764570:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 142 00000100:00100000:1.0:1788890995.766377:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788890995.768719:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890995.768821:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875072 00000100:00100000:0.0:1788890995.768831:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875072 00000100:00100000:0.0:1788890995.768893:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 143 00000100:00100000:0.0:1788890995.768903:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:11367:x1875787987875072:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:0.0:1788890995.768923:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890995.768944:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f7e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e98 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.769092:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.769107:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.769119:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.769219:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.769227:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.769234:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890995.769504:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996264704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788890995.769562:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890995.769621:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996264704 00000100:00100000:1.0:1788890995.769625:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996264704 00000100:00100000:1.0:1788890995.769709:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788890995.769718:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996264704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788890995.769744:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000004:00080000:0.0:1788890995.769874:0:11412:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00000100:00100000:1.0:1788890995.770006:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996264704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890995.770021:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1788890995.770030:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770041:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770048:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770080:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770097:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770104:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770110:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890995.770114:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770121:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770141:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890995.770145:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890995.770149:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770155:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f7e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890995.770193:0:11412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002637abff reply state 000000009aba6f38 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890995.770202:0:11412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788890995.770224:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996264704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788890995.770232:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8e00/0x9161b78f8ec3f7e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e98 expref: 20 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770248:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e98 expref: 19 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.770268:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ca00) 00010000:00010000:0.0:1788890995.770270:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788890995.770272:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8a00, rc 0) 00000100:00100000:0.0:1788890995.770325:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:11367:x1875787987875072:12345-192.168.204.18@tcp:101:bash.0 Request processed in 1423us (1613us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788890995.770332:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 143 00010000:00010000:2.0:1788890995.772705:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.772722:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.772729:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.772736:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890995.772740:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.772747:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.772775:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870c700) 00010000:00010000:2.0:1788890995.772778:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890995.772783:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.772789:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f7ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890995.779472:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890995.779703:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875200 00000100:00100000:3.0:1788890995.779714:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875200 00000100:00100000:3.0:1788890995.779790:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:3.0:1788890995.779802:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987875200:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:3.0:1788890995.779821:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890995.779844:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1e9f expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890995.779871:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788890995.779890:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=219s v=(0 0) 00010000:00010000:3.0:1788890995.779907:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890995.779917:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e9f expref: 6 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.779938:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e9f expref: 6 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.779953:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd800, rc 0) 00000100:00080000:1.0:1788890995.780067:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788890995.780103:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2373:x1875787987875200:12345-192.168.204.18@tcp:101:bash.0 Request processed in 302us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890995.780110:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:3.0:1788890995.786099:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890995.786206:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875328 00000100:00100000:0.0:1788890995.786215:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875328 00000100:00100000:0.0:1788890995.786375:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:0.0:1788890995.786387:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:11367:x1875787987875328:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:0.0:1788890995.786405:0:6664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890995.786423:0:6664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ea6 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.786456:0:6664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e9f expref: 7 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.786466:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890995.786471:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890995.786476:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.786510:0:6664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e9f expref: 7 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.786542:0:6664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e9f expref: 7 pid: 6662 timeout: 319 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890995.786557:0:6664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3799f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6664:1875787996264832:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890995.786706:0:6664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5ade900 going to sleep for 11 seconds 00000100:00100000:0.0:1788890995.788546:0:6664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3799f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6664:1875787996264832:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890995.788575:0:6664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.788593:0:6664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8e00, rc 0) 00000100:00100000:0.0:1788890995.788677:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:11367:x1875787987875328:12345-192.168.204.18@tcp:101:bash.0 Request processed in 2292us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890995.788685:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:3.0:1788890995.789867:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890995.790632:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875456 00000100:00100000:0.0:1788890995.790640:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875456 00010000:00010000:0.0:1788890995.790674:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e9f expref: 7 pid: 6662 timeout: 319 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890995.790715:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:0.0:1788890995.790725:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2375:x1875787987875456:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890995.790737:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890995.790758:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e9f expref: 7 pid: 6662 timeout: 319 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.790787:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e9f expref: 7 pid: 6662 timeout: 319 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.790809:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc755ef7/0x9161b78f8ec3f803 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e9f expref: 7 pid: 6662 timeout: 319 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.790824:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890995.790828:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890995.790834:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.790844:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.790878:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890995.790893:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3799f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1875787996264960:192.168.204.18@tcp:105: 00000100:00100000:0.0:1788890995.791011:0:5799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5ade900 going to sleep for 11 seconds 00000100:00100000:2.0:1788890995.792472:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3799f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1875787996264960:192.168.204.18@tcp:105: 00010000:00010000:2.0:1788890995.792496:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890995.792616:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987875456:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 1891us (2752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890995.792628:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:3.0:1788890995.794486:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890995.794649:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875712 00000100:00100000:2.0:1788890995.794657:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875712 00000100:00100000:2.0:1788890995.794745:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 36 00000100:00100000:2.0:1788890995.794755:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:11367:x1875787987875712:12345-192.168.204.18@tcp:35:bash.0 00000100:00100000:2.0:1788890995.795153:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:11367:x1875787987875712:12345-192.168.204.18@tcp:35:bash.0 Request processed in 399us (674us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788890995.795161:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 36 00010000:00010000:2.0:1788890995.830875:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890995.847533:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890995.847633:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987875968 00000100:00100000:0.0:1788890995.847641:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987875968 00000100:00100000:0.0:1788890995.847722:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 144 00000100:00100000:0.0:1788890995.847731:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:11377:x1875787987875968:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890995.847763:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890995.847797:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ead expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890995.847895:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788890995.847999:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f811 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ead expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.848011:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:0.0:1788890995.848014:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788890995.848019:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ead expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.848033:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8600, rc 0) 00000100:00100000:0.0:1788890995.848096:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:11377:x1875787987875968:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 366us (573us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788890995.848103:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 144 00000100:00100000:1.0:1788890995.850413:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890995.850570:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876224 00000100:00100000:3.0:1788890995.850579:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876224 00000100:00100000:3.0:1788890995.850665:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:3.0:1788890995.850674:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:11377:x1875787987876224:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890995.850906:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:11377:x1875787987876224:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 233us (501us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788890995.850914:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:3.0:1788890995.906783:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890995.906954:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876352 00000100:00100000:2.0:1788890995.906964:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876352 00000100:00100000:2.0:1788890995.907023:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 145 00000100:00100000:2.0:1788890995.907034:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:11383:x1875787987876352:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890995.907058:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890995.907103:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f81f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1eb4 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.907206:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.907220:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.907232:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890995.907268:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788890995.907272:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890995.907288:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.907316:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3f81f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1eb4 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.907335:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1eb4 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.907344:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890995.907347:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890995.907351:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87400, rc 0) 00000100:00100000:2.0:1788890995.907416:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:11383:x1875787987876352:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 384us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890995.907423:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 145 00000100:00100000:2.0:1788890995.912210:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890995.912880:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876608 00000100:00100000:0.0:1788890995.912891:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876608 00000100:00100000:0.0:1788890995.912961:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 146 00000100:00100000:0.0:1788890995.912973:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:11383:x1875787987876608:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890995.912995:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890995.913021:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f82d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ebb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.913141:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f834 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.913157:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.913228:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890995.913242:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788890995.913377:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f82d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ebb expref: 26 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.913395:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ebb expref: 25 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.913403:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ca00) 00010000:00010000:0.0:1788890995.913406:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788890995.913410:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9e00, rc 0) 00000100:00100000:0.0:1788890995.913476:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11383:x1875787987876608:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 504us (1311us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788890995.913483:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 146 00000100:00100000:1.0:1788890995.916006:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890995.916773:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890995.917718:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876992 00000100:00100000:3.0:1788890995.917739:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876992 00000100:00100000:3.0:1788890995.917814:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:3.0:1788890995.917825:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:2374:x1875787987876992:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890995.917856:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890995.917883:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3f834 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ebb expref: 25 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.917901:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ca00) 00010000:00010000:3.0:1788890995.917907:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890995.918101:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987876864 00000100:00100000:0.0:1788890995.918107:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987876864 00000100:00100000:0.0:1788890995.918149:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 147 00000100:00100000:0.0:1788890995.918157:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11383:x1875787987876864:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890995.918193:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890995.918219:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f842 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ec2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890995.918599:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:2374:x1875787987876992:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 774us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890995.918609:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 11 00010000:00010000:0.0:1788890995.918660:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f849 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.918687:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.918698:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890995.918712:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788890995.919611:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ec2 expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.919632:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f849 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ec2 expref: 26 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.919640:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ca00) 00010000:00010000:0.0:1788890995.919648:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788890995.919651:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8800, rc 0) 00000100:00100000:0.0:1788890995.919693:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11383:x1875787987876864:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 1537us (3696us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788890995.919700:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 147 00000100:00100000:1.0:1788890995.926272:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890995.926337:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877120 00000100:00100000:0.0:1788890995.926347:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877120 00000100:00100000:0.0:1788890995.926405:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 49 00000100:00100000:0.0:1788890995.926415:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2375:x1875787987877120:12345-192.168.204.18@tcp:1:lfs.0 00010000:00010000:0.0:1788890995.926460:0:11963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.926482:0:11963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.926506:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890995.926511:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788890995.926516:0:11963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.926555:0:11963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890995.926571:0:11963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 6 pid: 6664 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890995.926586:0:11963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11963:1875787996265088:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890995.926676:0:11963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5ade600 going to sleep for 11 seconds 00000100:00100000:1.0:1788890995.932909:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890995.932955:0:11963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11963:1875787996265088:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890995.932981:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877248 00010000:00010000:0.0:1788890995.932983:0:11963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890995.932990:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877248 00002000:00100000:3.0:1788890995.933037:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9da201fa2a00 x1875787987877248/t0(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:46/0 lens 504/0 e 0 to 0 dl 1788891006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788890995.933047:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da201fa2a00 with x1875787987877248 ext(0->12) 00010000:00010000:3.0:1788890995.933055:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 7 pid: 6664 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.933069:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 7 pid: 6664 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890995.933077:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9da201fa2a00 00000100:00100000:3.0:1788890995.933110:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:3.0:1788890995.933123:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987877248:12345-192.168.204.18@tcp:4:lfs.0 00000100:00100000:2.0:1788890995.934591:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2374:x1875787987877248:12345-192.168.204.18@tcp:4:lfs.0 Request processed in 1465us (1686us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788890995.934605:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 2 00002000:00100000:2.0:1788890995.934615:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9da201fa2a00 x1875787987877248/t4294967305(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:46/0 lens 504/448 e 0 to 0 dl 1788891006 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788890995.934624:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da201fa2a00 with x1875787987877248 ext(0->12) 00010000:00010000:2.0:1788890995.934630:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 9 pid: 6664 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.934644:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 9 pid: 6664 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788890995.934652:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9da201fa2a00 00000100:00100000:2.0:1788890995.937266:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890995.937431:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877376 00000100:00100000:1.0:1788890995.937441:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877376 00010000:00010000:1.0:1788890995.937481:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 9 pid: 6664 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890995.937556:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 62 00000100:00100000:1.0:1788890995.937567:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987877376:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890995.937581:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788890995.937598:0:5801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788890995.937602:0:5801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788890996 00002000:00010000:1.0:1788890995.937604:0:5801:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788890996 00002000:00010000:1.0:1788890995.937606:0:5801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788890996 00010000:00010000:1.0:1788890995.937612:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 9 pid: 6664 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.937627:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 9 pid: 6664 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.937651:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000681713f/0x9161b78f8ec3f80a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ea6 expref: 9 pid: 6664 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.937669:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788890995.937674:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788890995.937680:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.937690:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.937722:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788890995.937969:0:11963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.937990:0:11963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.938015:0:11963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.938022:0:11963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.938030:0:11963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.938037:0:11963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9a00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890995.938040:0:11963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.938049:0:11963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.938061:0:11963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.938070:0:11963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019580c45/0x9161b78f8ec3f857 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890995.938220:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987877376:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 654us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890995.938228:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 62 00000100:00100000:2.0:1788890995.939725:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2375:x1875787987877120:12345-192.168.204.18@tcp:1:lfs.0 Request processed in 13305us (13457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890995.939737:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 49 00000100:00100000:2.0:1788890995.942108:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890995.942419:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877632 00000100:00100000:1.0:1788890995.942429:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877632 00000100:00100000:1.0:1788890995.942516:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 38 00000100:00100000:1.0:1788890995.942527:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8c02c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11383:x1875787987877632:12345-192.168.204.18@tcp:35:lfs.0 00000004:00010000:1.0:1788890995.942591:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f849 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ec2 expref: 26 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788890995.942897:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788890995.942943:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788890995.943692:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788890995.943751:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.943767:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e98 expref: 30 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.943776:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.943888:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e98 expref: 30 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890995.943903:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e98 expref: 30 pid: 11412 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890995.943918:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4f23800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1875787996265216:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788890995.944070:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700300 going to sleep for 11 seconds 00000100:00100000:1.0:1788890995.950229:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890995.950325:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877760 00000100:00100000:3.0:1788890995.950335:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877760 00010000:00010000:3.0:1788890995.950374:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e98 expref: 31 pid: 11412 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890995.950409:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 63 00000100:00100000:3.0:1788890995.950419:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:2374:x1875787987877760:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890995.950433:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890995.950440:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e98 expref: 31 pid: 11412 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.950453:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e98 expref: 31 pid: 11412 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.950473:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ca00) 00010000:00010000:3.0:1788890995.950479:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.950488:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.950508:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.950535:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890995.950630:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:2374:x1875787987877760:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890995.950656:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 63 00010000:00010000:2.0:1788890995.951329:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3f7f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e98 expref: 30 pid: 11412 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890995.951357:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4f23800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1875787996265216:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890995.951476:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.951509:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.951515:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890995.951675:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788890995.951943:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788890995.952101:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c328b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875787996265344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788890995.952643:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890995.952697:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe180 going to sleep for 11 seconds 00000100:00100000:3.0:1788890995.953562:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996265344 00000100:00100000:3.0:1788890995.953583:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996265344 00000100:00100000:2.0:1788890995.953810:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788890995.953822:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5818:x1875787996265344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788890995.954013:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5818:x1875787996265344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 192us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890995.954021:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788890995.955261:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c328b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875787996265344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788890995.956671:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788890995.956768:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875787996265472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788890995.956835:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890995.956923:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf180 going to sleep for 11 seconds 00000100:00100000:0.0:1788890995.957269:0:11998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996265472 00000100:00100000:0.0:1788890995.957277:0:11998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996265472 00000100:00100000:0.0:1788890995.957438:0:11998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788890995.957449:0:11998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c328b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5818:x1875787996265472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788890995.957689:0:11998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c328b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5818:x1875787996265472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 241us (853us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788890995.957698:0:11998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788890995.957797:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f35f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875787996265472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788890995.957864:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788890995.957905:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.957917:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.957924:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.957930:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890995.957934:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.957942:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.957959:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ca00) 00010000:00010000:3.0:1788890995.957962:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788890995.957966:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890995.957973:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3f85e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788890995.958163:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788890995.958305:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788890995.958316:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 219807146636ns, next at 220807144581ns, rc = 0 00000001:00080000:3.0:1788890995.958322:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788890995.958352:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ca00) 00010000:00010000:3.0:1788890995.958355:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788890995.958362:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3f849 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ec2 expref: 34 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890995.958455:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8c02c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:11383:x1875787987877632:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 15929us (16356us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788890995.958464:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 38 00000020:00080000:3.0:1788890995.958468:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788890995.960735:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890995.960819:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987877888 00000100:00100000:2.0:1788890995.960827:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987877888 00000100:00100000:2.0:1788890995.960890:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 148 00000100:00100000:2.0:1788890995.960900:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:11383:x1875787987877888:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890995.960921:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890995.960944:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ec9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.961023:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ec9 expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.961039:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ec9 expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890995.961059:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890995.961062:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890995.961066:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87a00, rc 0) 00000100:00100000:2.0:1788890995.961122:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:11383:x1875787987877888:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 224us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890995.961139:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 148 00000100:00100000:3.0:1788890995.965204:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890995.967324:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878144 00000100:00100000:2.0:1788890995.967340:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878144 00000100:00100000:2.0:1788890995.967407:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:2.0:1788890995.967418:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:11383:x1875787987878144:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788890995.967692:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:11383:x1875787987878144:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 276us (2536us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788890995.967700:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:1.0:1788890996.052937:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890996.053086:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878400 00000100:00100000:3.0:1788890996.053096:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878400 00000100:00080000:1.0:1788890996.053157:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788890996.053228:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 149 00000100:00100000:3.0:1788890996.053249:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:11393:x1875787987878400:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890996.056667:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890996.056703:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f86c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ed0 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890996.056801:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788890996.056931:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f86c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed0 expref: 37 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.056958:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:2.0:1788890996.056961:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788890996.056965:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3f86c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed0 expref: 37 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.056980:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86c00, rc 0) 00000100:00100000:2.0:1788890996.057058:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11393:x1875787987878400:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 3811us (4131us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788890996.061728:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 149 00000100:00100000:1.0:1788890996.062216:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.062366:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878528 00000100:00100000:0.0:1788890996.062376:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878528 00000100:00100000:0.0:1788890996.062433:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 150 00000100:00100000:0.0:1788890996.062623:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11393:x1875787987878528:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:0.0:1788890996.062714:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062735:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062749:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062768:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062774:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062780:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062887:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062895:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062903:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890996.062948:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062978:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062985:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062991:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.062997:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890996.063001:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063008:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063025:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890996.063028:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890996.063034:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063040:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f87a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063054:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063073:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063080:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063092:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890996.063096:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063102:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063111:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870c800) 00010000:00010000:0.0:1788890996.063114:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890996.063117:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063123:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063150:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063157:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063163:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063491:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890996.063495:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063502:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063594:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.063597:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890996.063601:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.063608:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.063702:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11393:x1875787987878528:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 1079us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890996.063711:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 150 00000100:00100000:3.0:1788890996.077125:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890996.079646:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987878784 00000100:00100000:2.0:1788890996.079663:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987878784 00000100:00100000:2.0:1788890996.079810:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 40 00000100:00100000:2.0:1788890996.079822:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11393:x1875787987878784:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788890996.080114:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11393:x1875787987878784:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 293us (2998us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788890996.080122:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 40 00000100:00100000:1.0:1788890996.108936:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.109101:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879040 00000100:00100000:0.0:1788890996.109111:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879040 00000100:00100000:0.0:1788890996.109255:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 151 00000100:00100000:0.0:1788890996.109268:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11396:x1875787987879040:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890996.109293:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890996.109315:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f88f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ed7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109424:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109440:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109452:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109469:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109491:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109499:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109630:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109640:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109647:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890996.109657:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788890996.109764:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109772:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109778:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109785:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890996.109790:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109797:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109820:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890996.109823:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890996.109828:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109834:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f896 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109848:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109854:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109860:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109866:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890996.109869:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109875:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109884:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870c800) 00010000:00010000:0.0:1788890996.109886:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890996.109889:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109895:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f89d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109947:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f88f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed7 expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109962:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed7 expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.109970:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.109972:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788890996.109975:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9c00, rc 0) 00000100:00100000:0.0:1788890996.110051:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:11396:x1875787987879040:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 779us (1118us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788890996.110058:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 151 00000100:00100000:1.0:1788890996.113247:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890996.113578:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879168 00000100:00100000:2.0:1788890996.113589:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879168 00000100:00100000:2.0:1788890996.113657:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 152 00000100:00100000:2.0:1788890996.113669:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:11396:x1875787987879168:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:2.0:1788890996.113741:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.113759:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.113791:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.113820:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.113827:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.113834:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.113840:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890996.113845:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.113852:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.113864:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890996.113868:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788890996.113873:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.113879:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3f8b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890996.113950:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:11396:x1875787987879168:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 284us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890996.113959:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 152 00000100:00100000:2.0:1788890996.117021:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890996.117141:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879424 00000100:00100000:3.0:1788890996.117152:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879424 00000100:00100000:3.0:1788890996.117305:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00100000:3.0:1788890996.117317:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:11396:x1875787987879424:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890996.117569:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:11396:x1875787987879424:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 254us (558us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788890996.117577:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00100000:3.0:1788890996.316737:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.317265:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879680 00000100:00100000:0.0:1788890996.317276:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879680 00000100:00100000:0.0:1788890996.317371:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 153 00000100:00100000:0.0:1788890996.317382:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:11427:x1875787987879680:12345-192.168.204.18@tcp:101:cat.0 00010000:00010000:0.0:1788890996.317424:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890996.317450:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ede expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.317568:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.317581:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.317596:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890996.317622:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788890996.317862:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ede expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.317881:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ede expref: 42 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.317890:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.317898:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788890996.317978:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9800, rc 0) 00000100:00100000:0.0:1788890996.318052:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:11427:x1875787987879680:12345-192.168.204.18@tcp:101:cat.0 Request processed in 672us (1326us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788890996.318060:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 153 00000100:00100000:1.0:1788890996.332776:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890996.332887:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987879936 00000100:00100000:2.0:1788890996.332897:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987879936 00000100:00100000:2.0:1788890996.332955:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 42 00000100:00100000:2.0:1788890996.332964:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:11427:x1875787987879936:12345-192.168.204.18@tcp:35:cat.0 00000100:00100000:2.0:1788890996.333280:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+43:11427:x1875787987879936:12345-192.168.204.18@tcp:35:cat.0 Request processed in 316us (514us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788890996.333288:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 42 00000001:00080000:0.0:1788890996.335523:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000020:00080000:0.0:1788890996.335569:0:5836:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9da1c9ab1600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788890996.335574:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1d07f7d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9da1c9ab1cc0 00000020:00080000:0.0:1788890996.335578:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1d07f7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9da201c7a400 00000020:00080000:0.0:1788890996.335599:0:5836:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788890996.335604:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:0.0:1788890996.335610:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788890996.335633:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788890996.335798:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788890996.336020:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788890996.336038:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996265600:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788890996.336102:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788890996.336203:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996265600 00000100:00100000:3.0:1788890996.336210:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996265600 00000100:00100000:3.0:1788890996.336257:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788890996.336266:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1875787996265600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788890996.336293:0:6663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788890996.336327:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa04f74, atime: 0x6aa04f74, ctime: 0x6aa04f74, blocks: 0x1 00010000:00010000:3.0:1788890996.336336:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.336352:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=220s v=(0 0) 00010000:00010000:3.0:1788890996.336356:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890996.336363:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.336378:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.336388:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.336395:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.336432:0:6663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788890996.336925:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1875787996265600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 659us (821us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788890996.336932:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788890996.336958:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890996.336963:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.336980:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890996.336984:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.336993:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.337010:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.337017:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000addeef57/0x9161b78f8ec3f8ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.337035:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890996.337037:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890996.337038:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788890996.337069:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da1ffec8000/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788890996.337075:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996265600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788890996.340048:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890996.341677:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880064 00000100:00100000:1.0:1788890996.341692:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880064 00000100:00100000:0.0:1788890996.342291:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:0.0:1788890996.342306:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f16850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:2372:x1875787987880064:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890996.342328:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890996.342377:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ede expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.342398:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.342405:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890996.342478:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f16850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:2372:x1875787987880064:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 177us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890996.343047:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:1.0:1788890996.389075:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.389197:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880320 00000100:00100000:0.0:1788890996.389207:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880320 00000100:00100000:0.0:1788890996.389280:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 154 00000100:00100000:0.0:1788890996.389290:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:11433:x1875787987880320:12345-192.168.204.18@tcp:101:dd.0 00010000:00010000:0.0:1788890996.389313:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890996.389316:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788890996.389343:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3f826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1eb4 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.389363:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890996.389368:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890996.389381:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ee5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.389482:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.389498:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed7 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.389524:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.389560:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed7 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.389574:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed7 expref: 19 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.389589:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996265728:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890996.389694:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681840 going to sleep for 11 seconds 00000100:00100000:2.0:1788890996.393403:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890996.393557:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880448 00000100:00100000:1.0:1788890996.393568:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880448 00010000:00010000:1.0:1788890996.393610:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed7 expref: 20 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890996.393656:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 64 00000100:00100000:1.0:1788890996.393668:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:2375:x1875787987880448:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890996.393683:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890996.393691:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed7 expref: 20 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.393706:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed7 expref: 20 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.393743:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:1.0:1788890996.393748:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.393772:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.393780:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.393802:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890996.393868:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:2375:x1875787987880448:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 202us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890996.393876:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 64 00010000:00010000:0.0:1788890996.394224:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ed7 expref: 19 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.394256:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996265728:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890996.394276:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.394286:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.394292:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890996.394311:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788890996.394465:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ee5 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.394493:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ee5 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.394501:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.394504:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788890996.394507:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8200, rc 0) 00000100:00100000:0.0:1788890996.394550:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:11433:x1875787987880320:12345-192.168.204.18@tcp:101:dd.0 Request processed in 5261us (5486us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788890996.394557:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 154 00000100:00100000:2.0:1788890996.406923:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.407025:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880704 00000100:00100000:0.0:1788890996.407036:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880704 00000100:00100000:0.0:1788890996.407094:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 155 00000100:00100000:0.0:1788890996.407104:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:11433:x1875787987880704:12345-192.168.204.18@tcp:36:dd.0 00010000:00010000:0.0:1788890996.407459:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.407478:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.407491:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788890996.407540:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788890996.407565:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000421305c reply state 00000000de2e629b transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.407575:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890996.407686:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:11433:x1875787987880704:12345-192.168.204.18@tcp:36:dd.0 Request processed in 582us (774us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788890996.407694:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 155 00000020:00080000:0.0:1788890996.407698:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788890996.410201:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.410218:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.410226:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.410280:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890996.410285:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.410293:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.410311:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:1.0:1788890996.410315:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890996.410320:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890996.410343:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3f8ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890996.645054:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.645206:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987880832 00000100:00100000:0.0:1788890996.645216:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987880832 00000100:00100000:0.0:1788890996.645279:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 156 00000100:00100000:0.0:1788890996.645290:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:11447:x1875787987880832:12345-192.168.204.18@tcp:101:stat.0 00010000:00010000:0.0:1788890996.645389:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890996.645411:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1eec expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.645479:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.645493:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.645505:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.645520:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.645528:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.645535:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.645831:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.645851:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ee5 expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.645860:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.646947:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ee5 expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.646967:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ee5 expref: 22 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.646982:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996265856:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890996.647092:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5ade900 going to sleep for 11 seconds 00000100:00100000:3.0:1788890996.650613:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890996.650710:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881088 00000100:00100000:2.0:1788890996.650720:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881088 00000100:00100000:2.0:1788890996.650776:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:2.0:1788890996.650793:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:5600:x1875787987881088:12345-192.168.204.18@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788890996.651505:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996265856:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890996.651532:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890996.651584:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:5600:x1875787987881088:12345-192.168.204.18@tcp:35:ldlm_bl.0 Request processed in 799us (980us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788890996.651593:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:3.0:1788890996.655605:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.655836:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881216 00000100:00100000:0.0:1788890996.655848:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881216 00010000:00010000:0.0:1788890996.655960:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ee5 expref: 24 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.656015:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 65 00000100:00100000:0.0:1788890996.656026:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:2375:x1875787987881216:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890996.656041:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890996.656064:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ee5 expref: 24 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.656078:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ee5 expref: 24 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.656103:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f8dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ee5 expref: 24 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.656128:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.656134:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.656142:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.656150:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.656287:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890996.656411:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:2375:x1875787987881216:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 387us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890996.656420:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 65 00010000:00010000:3.0:1788890996.657969:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.657985:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890996.658036:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788890996.658041:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788890996.658070:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658085:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658094:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658100:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658107:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658113:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890996.658129:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658137:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658151:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:3.0:1788890996.658227:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890996.658235:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658241:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f8f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658257:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658263:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658269:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658393:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890996.658398:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658406:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658415:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870c800) 00010000:00010000:3.0:1788890996.658417:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890996.658421:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658427:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f8ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658471:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f8f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1eec expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658568:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1eec expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.658576:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:3.0:1788890996.658579:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788890996.658581:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8400, rc 0) 00000100:00100000:3.0:1788890996.658705:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:11447:x1875787987880832:12345-192.168.204.18@tcp:101:stat.0 Request processed in 13415us (13660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890996.658715:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 156 00000100:00100000:3.0:1788890996.715495:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.717374:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881472 00000100:00100000:0.0:1788890996.717388:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881472 00000100:00100000:0.0:1788890996.717508:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 157 00000100:00100000:0.0:1788890996.717520:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:11453:x1875787987881472:12345-192.168.204.18@tcp:36:truncate.0 00010000:00010000:0.0:1788890996.717580:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890996.717609:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1eec expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.717647:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.717652:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890996.717885:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.717900:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.717911:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788890996.717968:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788890996.717995:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baf5c32b reply state 0000000000d42d70 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.718004:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890996.718122:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:11453:x1875787987881472:12345-192.168.204.18@tcp:36:truncate.0 Request processed in 595us (2628us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788890996.718130:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 157 00000020:00080000:0.0:1788890996.718135:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788890996.719907:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.719922:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.719928:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.719934:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890996.719953:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.719960:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.719974:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890996.719977:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890996.719981:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.719988:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f90d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890996.833085:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.833695:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881600 00000100:00100000:0.0:1788890996.833706:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881600 00000100:00100000:0.0:1788890996.833773:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 158 00000100:00100000:0.0:1788890996.833783:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:11467:x1875787987881600:12345-192.168.204.18@tcp:101:stat.0 00010000:00010000:0.0:1788890996.833807:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890996.833828:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f914 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ef3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.833915:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.833929:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.833940:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.833955:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.833963:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.833969:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834559:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834571:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834579:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890996.834619:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788890996.834623:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890996.834704:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834727:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834735:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834741:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834748:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834754:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890996.834757:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834764:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834775:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890996.834778:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890996.834782:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834788:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f91b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834800:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834806:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834817:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834822:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890996.834825:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834831:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834838:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870ce00) 00010000:00010000:0.0:1788890996.834841:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890996.834844:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834849:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f922 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834882:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ef3 expref: 25 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834896:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ef3 expref: 24 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.834903:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.834906:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788890996.834909:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9600, rc 0) 00000100:00100000:0.0:1788890996.835041:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:11467:x1875787987881600:12345-192.168.204.18@tcp:101:stat.0 Request processed in 1258us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890996.835058:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 158 00010000:00010000:3.0:1788890996.854519:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890996.890634:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890996.890732:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987881856 00000100:00100000:3.0:1788890996.890742:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987881856 00000100:00100000:3.0:1788890996.890818:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 159 00000100:00100000:3.0:1788890996.890830:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:11477:x1875787987881856:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788890996.890856:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890996.890883:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1efa expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890996.890990:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788890996.891135:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f930 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1efa expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.891149:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:3.0:1788890996.891152:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788890996.891211:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3f930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1efa expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.891226:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4eddc00, rc 0) 00000100:00100000:3.0:1788890996.891336:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11477:x1875787987881856:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 508us (713us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788890996.891352:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 159 00000100:00100000:1.0:1788890996.897991:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890996.899587:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882112 00000100:00100000:3.0:1788890996.899600:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882112 00000100:00100000:3.0:1788890996.899701:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 44 00000100:00100000:3.0:1788890996.900427:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8c00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11477:x1875787987882112:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890996.900708:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8c00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11477:x1875787987882112:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 997us (2727us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788890996.900717:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 44 00000100:00100000:1.0:1788890996.952372:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.952570:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882368 00000100:00100000:0.0:1788890996.952580:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882368 00000100:00100000:0.0:1788890996.952641:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 160 00000100:00100000:0.0:1788890996.952650:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11483:x1875787987882368:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:0.0:1788890996.952677:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890996.952698:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f93e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f01 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.952797:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.952811:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ef3 expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.952818:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.952849:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ef3 expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.952861:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ef3 expref: 27 pid: 5814 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.952873:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996265984:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890996.952976:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890996.957239:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996265984:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890996.957289:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890996.957312:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890996.957633:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882496 00000100:00100000:3.0:1788890996.957641:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882496 00010000:00010000:3.0:1788890996.957684:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ef3 expref: 28 pid: 5814 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890996.957855:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 66 00000100:00100000:3.0:1788890996.957867:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:2375:x1875787987882496:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890996.957881:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890996.957890:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ef3 expref: 28 pid: 5814 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.957903:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ef3 expref: 28 pid: 5814 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.957957:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f929 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ef3 expref: 28 pid: 5814 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.957978:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:3.0:1788890996.957983:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.957993:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.958002:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.958037:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890996.958100:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890996.958102:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:2375:x1875787987882496:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 237us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890996.958127:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 66 00010000:00010000:0.0:1788890996.958127:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890996.958155:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788890996.958381:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f93e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f01 expref: 28 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.958397:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f01 expref: 27 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.958405:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.958408:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788890996.958411:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8c00, rc 0) 00000100:00100000:0.0:1788890996.958437:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:11483:x1875787987882368:12345-192.168.204.18@tcp:101:bash.0 Request processed in 5789us (6077us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788890996.958445:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 160 00000100:00100000:1.0:1788890996.964989:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.965155:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882752 00000100:00100000:0.0:1788890996.965165:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882752 00000100:00100000:0.0:1788890996.965290:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 161 00000100:00100000:0.0:1788890996.965301:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:11483:x1875787987882752:12345-192.168.204.18@tcp:36:bash.0 00010000:00010000:0.0:1788890996.965811:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.965847:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.965860:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788890996.965915:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788890996.965956:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b07fb5d0 reply state 00000000a21c8bdc transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.965966:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890996.966058:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:11483:x1875787987882752:12345-192.168.204.18@tcp:36:bash.0 Request processed in 758us (1333us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788890996.966066:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 161 00000020:00080000:0.0:1788890996.966389:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788890996.968143:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.968159:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.968299:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.968305:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890996.968310:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.968334:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.968351:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:3.0:1788890996.968354:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890996.968360:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890996.968367:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3f953 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890996.971093:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890996.971144:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987882880 00000100:00100000:1.0:1788890996.971145:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890996.971154:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987882880 00000100:00100000:0.0:1788890996.971213:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883136 00000100:00100000:1.0:1788890996.971215:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.971219:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883136 00000100:00100000:3.0:1788890996.971224:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 272 00000100:00100000:3.0:1788890996.971236:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987882880:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890996.971244:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.971262:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883008 00000100:00100000:0.0:1788890996.971267:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883008 00000100:00100000:1.0:1788890996.971277:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890996.971303:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883264 00000100:00100000:1.0:1788890996.971308:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883264 00000100:00100000:3.0:1788890996.971309:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987882880:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890996.971313:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 67 00000100:00100000:3.0:1788890996.971322:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 272 00000100:00100000:1.0:1788890996.971339:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883392 00000100:00100000:0.0:1788890996.971340:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987883136:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890996.971343:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883392 00000100:00100000:3.0:1788890996.971355:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 68 00000100:00100000:3.0:1788890996.971364:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2373:x1875787987883008:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788890996.971368:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 108 00000100:00100000:1.0:1788890996.971376:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2373:x1875787987883264:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788890996.971380:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987883136:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 44us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890996.971390:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 67 00000100:00100000:3.0:1788890996.971398:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2373:x1875787987883008:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890996.971406:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 68 00000100:00100000:1.0:1788890996.971417:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2373:x1875787987883264:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890996.971424:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 162 00000100:00080000:3.0:1788890996.971448:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890996.971487:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 108 00000100:00100000:0.0:1788890996.971605:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:11483:x1875787987883392:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:0.0:1788890996.971620:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890996.971658:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f95a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f08 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.971751:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.971766:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f01 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.971775:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.971808:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f01 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.971822:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f01 expref: 30 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.971836:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996266112:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890996.971906:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5ade900 going to sleep for 11 seconds 00000100:00100000:0.0:1788890996.975455:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996266112:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890996.975495:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890996.976537:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890996.976737:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883520 00000100:00100000:0.0:1788890996.976745:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883520 00010000:00010000:0.0:1788890996.976784:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f01 expref: 31 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890996.976892:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 67 00000100:00100000:0.0:1788890996.976903:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:2374:x1875787987883520:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890996.976919:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890996.976939:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f01 expref: 31 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.976954:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f01 expref: 31 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.976976:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f945 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f01 expref: 31 pid: 5815 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.977001:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890996.977007:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.977018:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.977026:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890996.977062:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890996.977126:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:2374:x1875787987883520:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 225us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890996.977135:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 67 00010000:00010000:2.0:1788890996.977191:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.977203:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890996.977247:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788890996.977253:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890996.977272:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.977302:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3f95a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f08 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.977317:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f08 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890996.977338:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890996.977341:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890996.977344:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9600, rc 0) 00000100:00100000:2.0:1788890996.977369:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:11483:x1875787987883392:12345-192.168.204.18@tcp:101:bash.0 Request processed in 5936us (6091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890996.977376:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 162 00000100:00100000:1.0:1788890996.980876:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890996.980984:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987883776 00000100:00100000:2.0:1788890996.980994:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987883776 00000100:00100000:2.0:1788890996.981108:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:2.0:1788890996.981130:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:11483:x1875787987883776:12345-192.168.204.18@tcp:35:bash.0 00000100:00100000:2.0:1788890996.981503:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:11483:x1875787987883776:12345-192.168.204.18@tcp:35:bash.0 Request processed in 375us (707us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788890996.981511:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:3.0:1788890997.026903:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.027196:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884032 00000100:00100000:0.0:1788890997.027225:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884032 00000100:00100000:0.0:1788890997.027349:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 163 00000100:00100000:0.0:1788890997.027361:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+30:11493:x1875787987884032:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890997.027386:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890997.027408:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f968 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f0f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890997.027502:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788890997.027642:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f968 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f0f expref: 32 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.027658:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:0.0:1788890997.027661:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788890997.027667:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f968 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f0f expref: 32 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.027680:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8c00, rc 0) 00000100:00100000:0.0:1788890997.027786:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:11493:x1875787987884032:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 427us (892us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788890997.027794:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 163 00000100:00100000:1.0:1788890997.030632:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.031154:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884160 00000100:00100000:2.0:1788890997.031165:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884160 00000100:00100000:2.0:1788890997.031248:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 164 00000100:00100000:2.0:1788890997.031257:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:11493:x1875787987884160:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:2.0:1788890997.031339:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.031357:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.031369:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.031401:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.031408:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.031415:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.031925:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.031936:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.031943:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890997.031990:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032004:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032011:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032018:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032024:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890997.032028:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032044:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032057:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890997.032060:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890997.032065:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032071:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f976 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032085:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032090:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032096:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032102:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890997.032104:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032120:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032128:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c2aee000) 00010000:00010000:2.0:1788890997.032130:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890997.032133:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032148:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f97d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032193:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032200:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032206:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032216:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890997.032220:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032227:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032237:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890997.032239:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890997.032242:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.032247:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f984 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890997.032340:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:11493:x1875787987884160:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 1082us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890997.032349:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 164 00000100:00100000:1.0:1788890997.034560:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.034652:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884416 00000100:00100000:3.0:1788890997.034661:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884416 00000100:00100000:3.0:1788890997.034756:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 46 00000100:00100000:3.0:1788890997.034767:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:11493:x1875787987884416:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890997.035203:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:11493:x1875787987884416:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 436us (650us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788890997.035211:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 46 00000100:00100000:3.0:1788890997.069432:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.069753:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884672 00000100:00100000:2.0:1788890997.069763:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884672 00000100:00100000:2.0:1788890997.069879:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 165 00000100:00100000:2.0:1788890997.069889:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:11496:x1875787987884672:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890997.069915:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890997.069938:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f98b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f16 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070012:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070027:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070037:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070051:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070058:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070065:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070456:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f9a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070466:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070486:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890997.070497:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788890997.070600:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070608:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070615:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070622:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890997.070627:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070635:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070649:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890997.070652:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890997.070658:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070664:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3f992 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070676:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070682:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070697:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070703:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890997.070706:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070713:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070722:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c2aee000) 00010000:00010000:2.0:1788890997.070724:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890997.070727:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070733:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3f999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070779:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f98b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f16 expref: 35 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070794:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f16 expref: 34 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.070801:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890997.070804:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890997.070806:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87600, rc 0) 00000100:00100000:2.0:1788890997.070877:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:11496:x1875787987884672:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 988us (1458us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788890997.070894:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 165 00000100:00100000:1.0:1788890997.074644:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890997.074686:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.074789:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884800 00000100:00100000:2.0:1788890997.074800:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884800 00000100:00100000:2.0:1788890997.074862:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:2.0:1788890997.074872:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:2372:x1875787987884800:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890997.074889:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890997.074912:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f9a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f16 expref: 34 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.074932:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890997.074937:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890997.074994:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:2372:x1875787987884800:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 123us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890997.075002:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:0.0:1788890997.075069:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987884928 00000100:00100000:0.0:1788890997.075074:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987884928 00000100:00100000:0.0:1788890997.075121:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 166 00000100:00100000:0.0:1788890997.075129:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:11496:x1875787987884928:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:0.0:1788890997.075212:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.075225:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.075242:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.075277:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.075284:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.075290:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.075296:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.075301:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.075309:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.075318:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890997.075321:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788890997.075324:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.075330:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.075516:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:11496:x1875787987884928:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 387us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.075524:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 166 00000100:00100000:1.0:1788890997.076976:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.077040:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987885184 00000100:00100000:2.0:1788890997.077048:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987885184 00000100:00100000:2.0:1788890997.077094:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:2.0:1788890997.077104:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+33:11496:x1875787987885184:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788890997.079269:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:11496:x1875787987885184:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 2151us (2283us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788890997.079283:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:1.0:1788890997.197998:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.198103:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987885440 00000100:00100000:2.0:1788890997.198124:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987885440 00000100:00100000:0.0:1788890997.198398:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 167 00000100:00100000:0.0:1788890997.198428:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:11514:x1875787987885440:12345-192.168.204.18@tcp:101:cat.0 00010000:00010000:0.0:1788890997.198455:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890997.198479:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f1d expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.198584:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f9bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.198598:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f9bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.198613:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f9bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890997.198624:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788890997.199026:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f1d expref: 37 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.199045:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f9bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f1d expref: 36 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.199053:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788890997.199056:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788890997.199060:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8200, rc 0) 00000100:00100000:0.0:1788890997.199214:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11514:x1875787987885440:12345-192.168.204.18@tcp:101:cat.0 Request processed in 790us (1228us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788890997.199222:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 167 00000100:00100000:1.0:1788890997.231404:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.232437:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987885568 00000100:00100000:2.0:1788890997.232448:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987885568 00000100:00100000:2.0:1788890997.232560:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 168 00000100:00100000:2.0:1788890997.232585:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11515:x1875787987885568:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890997.232614:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890997.232635:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f9ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f24 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.232707:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f9d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.232718:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.232726:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890997.232752:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788890997.232755:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890997.232812:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.232837:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3f9ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f24 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.232855:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f24 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.232864:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890997.232867:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788890997.232871:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86e00, rc 0) 00000100:00100000:2.0:1788890997.232937:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11515:x1875787987885568:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 355us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890997.232954:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 168 00000100:00100000:1.0:1788890997.236448:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.237073:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987885952 00000100:00100000:2.0:1788890997.237083:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987885952 00000100:00100000:2.0:1788890997.237152:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:2.0:1788890997.237163:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11515:x1875787987885952:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788890997.237535:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:11515:x1875787987885952:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 373us (1096us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788890997.237543:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:1.0:1788890997.240199:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.240465:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886080 00000100:00100000:2.0:1788890997.240544:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886080 00000100:00100000:2.0:1788890997.240675:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:2.0:1788890997.240686:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:11515:x1875787987886080:12345-192.168.204.18@tcp:103:lfs.0 00010000:00010000:2.0:1788890997.240702:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788890997.240729:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3f961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f08 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.240751:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3f9bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f1d expref: 37 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.240771:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3f865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ec9 expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.240782:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890997.240794:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890997.240852:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:11515:x1875787987886080:12345-192.168.204.18@tcp:103:lfs.0 Request processed in 168us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890997.240880:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:3.0:1788890997.243687:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.243866:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886208 00000100:00100000:0.0:1788890997.243876:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886208 00000100:00100000:0.0:1788890997.243950:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 169 00000100:00100000:0.0:1788890997.243960:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:11515:x1875787987886208:12345-192.168.204.18@tcp:58:lfs.0 00010000:00010000:0.0:1788890997.244089:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.244117:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.244131:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788890997.245603:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788890997.245707:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:11515:x1875787987886208:12345-192.168.204.18@tcp:58:lfs.0 Request processed in 1746us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.245716:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 169 00000100:00100000:1.0:1788890997.275596:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.277269:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886336 00000100:00100000:0.0:1788890997.277285:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886336 00000100:00100000:0.0:1788890997.277434:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 170 00000100:00100000:0.0:1788890997.277447:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:11517:x1875787987886336:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890997.277470:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890997.277494:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f2b expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.277565:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.277584:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.277597:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.277634:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.277642:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.277650:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.277947:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.277956:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.277964:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890997.278001:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788890997.278006:0:6852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890997.278026:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278038:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278060:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278066:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278082:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278088:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.278092:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278100:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278130:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890997.278134:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890997.278138:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278144:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3f9e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278156:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278161:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278212:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278217:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.278220:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278236:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278244:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870cd00) 00010000:00010000:0.0:1788890997.278247:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890997.278250:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278255:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3f9ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278287:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f2b expref: 37 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278301:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f2b expref: 36 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.278309:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ce00) 00010000:00010000:0.0:1788890997.278311:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788890997.278314:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9000, rc 0) 00000100:00100000:0.0:1788890997.278386:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11517:x1875787987886336:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 940us (2803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.278394:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 170 00000040:00080000:0.0:1788890997.367422:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788890997.367432:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788890997.367469:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788890997.367476:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788890997.367589:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996266240:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788890997.367715:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c56813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890997.375631:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3798a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996266240:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788890997.376258:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.376439:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886464 00000100:00100000:0.0:1788890997.376446:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886464 00000100:00100000:0.0:1788890997.376508:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 171 00000100:00100000:0.0:1788890997.376518:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11528:x1875787987886464:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788890997.376549:0:5815:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788890997.376651:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11528:x1875787987886464:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 134us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.376659:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 171 00000100:00100000:1.0:1788890997.378541:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.378719:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886592 00000100:00100000:0.0:1788890997.378727:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886592 00000100:00100000:0.0:1788890997.378787:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 172 00000100:00100000:0.0:1788890997.378854:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11528:x1875787987886592:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788890997.378914:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.378928:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.378937:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.378950:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.378955:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.378970:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.378992:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.378997:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379001:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890997.379033:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788890997.379036:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890997.379046:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379054:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379058:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379062:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379066:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.379068:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379073:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379089:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:0.0:1788890997.379091:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890997.379095:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379099:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3f9fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379123:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379126:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379130:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379134:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.379136:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379139:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379144:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9da1c870cd00) 00010000:00010000:0.0:1788890997.379146:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890997.379148:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379152:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa02 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379313:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379390:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379397:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379402:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.379406:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379412:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379422:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ce00) 00010000:00010000:0.0:1788890997.379424:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890997.379427:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.379433:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fa09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.379666:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11528:x1875787987886592:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 Request processed in 870us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.379675:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 172 00000100:00100000:2.0:1788890997.384847:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.384913:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886848 00000100:00100000:0.0:1788890997.384922:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886848 00000100:00100000:0.0:1788890997.385075:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 173 00000100:00100000:0.0:1788890997.385111:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11528:x1875787987886848:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788890997.385133:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890997.385153:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fa10 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f32 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385300:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385315:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385325:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890997.385336:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788890997.385446:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385455:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385462:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385471:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.385476:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385485:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385496:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ce00) 00010000:00010000:0.0:1788890997.385504:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788890997.385510:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385517:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fa17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385553:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fa10 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f32 expref: 38 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385564:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:0.0:1788890997.385566:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788890997.385575:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fa10 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f32 expref: 38 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.385584:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9800, rc 0) 00000100:00100000:0.0:1788890997.385659:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11528:x1875787987886848:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 570us (821us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788890997.385666:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 173 00000100:00100000:1.0:1788890997.391437:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.391511:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987886976 00000100:00100000:2.0:1788890997.391520:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987886976 00000100:00100000:2.0:1788890997.391585:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 174 00000100:00100000:2.0:1788890997.391597:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11528:x1875787987886976:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788890997.391632:0:11412:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788890997.391741:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11528:x1875787987886976:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 147us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890997.391749:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 174 00000100:00100000:0.0:1788890997.393913:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890997.394583:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987887232 00000100:00100000:1.0:1788890997.394594:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987887232 00000100:00100000:1.0:1788890997.394753:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 175 00000100:00100000:1.0:1788890997.394764:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11528:x1875787987887232:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788890997.394785:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890997.394788:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788890997.394827:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3f9d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f24 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.394847:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890997.394852:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890997.394866:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fa25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f39 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788890997.395628:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788890997.395890:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fa2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.395905:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fa2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.395923:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fa2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.395982:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fa25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f39 expref: 39 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.395998:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fa2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f39 expref: 38 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.396007:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fc500) 00010000:00010000:1.0:1788890997.396009:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788890997.396012:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f600, rc 0) 00000100:00100000:1.0:1788890997.396352:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:11528:x1875787987887232:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 1588us (2444us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788890997.396361:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 175 00000100:00100000:0.0:1788890997.399840:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.400490:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987887488 00000100:00100000:2.0:1788890997.400500:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987887488 00000100:00100000:2.0:1788890997.400564:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 176 00000100:00100000:2.0:1788890997.400577:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:11528:x1875787987887488:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788890997.400636:0:6852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890997.400666:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fa2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f39 expref: 38 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.400686:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fc500) 00010000:00010000:2.0:1788890997.400703:0:6852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890997.400726:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.400740:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.400855:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.400904:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.400914:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.400921:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401203:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401212:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401220:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401226:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890997.401230:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401239:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401249:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890997.401253:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890997.401257:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401263:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401283:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401289:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401295:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401301:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890997.401304:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401311:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401319:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfe94419c (ffff9da1c2aee400) 00010000:00010000:2.0:1788890997.401322:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890997.401324:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.401330:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfe94419c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890997.401462:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11528:x1875787987887488:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 887us (1628us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788890997.401471:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 176 00000100:00100000:0.0:1788890997.405514:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890997.405793:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987887616 00000100:00100000:1.0:1788890997.405803:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987887616 00000100:00100000:1.0:1788890997.405874:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 177 00000100:00100000:1.0:1788890997.405894:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11528:x1875787987887616:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788890997.405919:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890997.405942:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fa48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f40 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.405978:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.405992:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.406011:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.406113:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fa48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f40 expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.406132:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f40 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.406141:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:1.0:1788890997.406144:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788890997.406148:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f000, rc 0) 00000100:00100000:1.0:1788890997.406233:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:11528:x1875787987887616:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 349us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890997.408257:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 177 00000100:00100000:1.0:1788890997.408927:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.410073:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987887872 00000100:00100000:0.0:1788890997.410083:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987887872 00000100:00100000:0.0:1788890997.411364:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 178 00000100:00100000:0.0:1788890997.411378:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:11528:x1875787987887872:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788890997.411459:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.411486:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.411498:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788890997.411806:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788890997.411818:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 221260649304ns, next at 222260646777ns, rc = 0 00000004:00010000:0.0:1788890997.411913:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4bdd283 reply state 000000004500512c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.411923:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890997.412022:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:11528:x1875787987887872:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 647us (3095us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788890997.412030:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 178 00010000:00010000:3.0:1788890997.413955:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.413968:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.413976:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.413982:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890997.413988:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.413995:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.414013:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:3.0:1788890997.414016:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788890997.414021:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.414028:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fa56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890997.414891:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.415063:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888000 00000100:00100000:3.0:1788890997.415073:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888000 00000100:00100000:3.0:1788890997.415130:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 179 00000100:00100000:3.0:1788890997.415140:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:11528:x1875787987888000:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788890997.415163:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890997.415198:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f47 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.415254:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f47 expref: 40 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.415268:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f47 expref: 40 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.415286:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:3.0:1788890997.415289:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788890997.415292:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4eddc00, rc 0) 00000100:00100000:3.0:1788890997.415346:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:11528:x1875787987888000:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 208us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890997.415353:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 179 00000100:00100000:1.0:1788890997.422903:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.424031:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888128 00000100:00100000:0.0:1788890997.424043:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888128 00000100:00100000:0.0:1788890997.424092:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:0.0:1788890997.424113:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+6:2373:x1875787987888128:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788890997.424478:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987888128:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 376us (1583us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788890997.424486:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:2.0:1788890997.428775:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.428843:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888384 00000100:00100000:0.0:1788890997.428853:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888384 00000100:00100000:0.0:1788890997.428910:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 49 00000100:00100000:0.0:1788890997.428921:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:11528:x1875787987888384:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788890997.429193:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+41:11528:x1875787987888384:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 273us (428us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788890997.429217:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 49 00000100:00100000:2.0:1788890997.436602:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890997.436873:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888640 00000100:00100000:1.0:1788890997.436882:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888640 00000100:00100000:1.0:1788890997.436939:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 180 00000100:00100000:1.0:1788890997.436948:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+41:11528:x1875787987888640:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788890997.437058:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+41:11528:x1875787987888640:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 110us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890997.437065:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 180 00000100:00100000:1.0:1788890997.440083:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.440320:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888768 00000100:00100000:2.0:1788890997.440337:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888768 00000100:00100000:2.0:1788890997.440397:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 181 00000100:00100000:2.0:1788890997.440406:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+41:11528:x1875787987888768:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788890997.440428:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890997.440450:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f4e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.440524:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fa6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.440538:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fa6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.440549:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fa6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890997.440595:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890997.440618:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fa6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.440646:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fa64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f4e expref: 43 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.440663:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fa6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f4e expref: 42 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.440672:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:2.0:1788890997.440675:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788890997.440679:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87200, rc 0) 00000100:00100000:2.0:1788890997.440739:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:11528:x1875787987888768:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 333us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890997.440751:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 181 00000100:00100000:2.0:1788890997.448191:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.448270:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987888896 00000100:00100000:3.0:1788890997.448280:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987888896 00000100:00100000:3.0:1788890997.448340:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 52 00000100:00100000:3.0:1788890997.448351:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2375:x1875787987888896:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788890997.448370:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890997.448404:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f55 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890997.448432:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa04f75, blocks: 0x1 00010000:00010000:3.0:1788890997.448452:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=221s v=(0 0) 00010000:00010000:3.0:1788890997.448456:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890997.448466:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f55 expref: 8 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.448486:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f55 expref: 8 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.448501:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc400, rc 0) 00000100:00100000:3.0:1788890997.448552:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987888896:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 203us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890997.448560:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 52 00000100:00100000:1.0:1788890997.451130:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.451861:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889152 00000100:00100000:2.0:1788890997.451874:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889152 00000100:00100000:2.0:1788890997.451934:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 182 00000100:00100000:2.0:1788890997.451943:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:11528:x1875787987889152:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788890997.452118:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:11528:x1875787987889152:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 176us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890997.452126:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 182 00000100:00100000:1.0:1788890997.461496:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.463213:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889280 00000100:00100000:0.0:1788890997.463237:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889280 00000100:00100000:0.0:1788890997.463304:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 53 00000100:00100000:0.0:1788890997.463315:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:11528:x1875787987889280:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788890997.463338:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890997.463361:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f5c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.463398:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f55 expref: 9 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.463407:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890997.463411:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890997.463417:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.463462:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f55 expref: 9 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.463476:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f55 expref: 9 pid: 6663 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.463490:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996266368:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890997.463595:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681840 going to sleep for 11 seconds 00000100:00100000:0.0:1788890997.465855:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996266368:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890997.465856:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00010000:00010000:0.0:1788890997.465892:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.465911:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8e00, rc 0) 00000100:00100000:3.0:1788890997.465938:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889408 00000100:00100000:3.0:1788890997.465947:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889408 00010000:00010000:3.0:1788890997.465990:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f55 expref: 10 pid: 6663 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.466021:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:11528:x1875787987889280:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 2706us (4540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890997.466029:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 68 00000100:00100000:0.0:1788890997.466035:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 53 00000100:00100000:3.0:1788890997.466046:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2375:x1875787987889408:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890997.466061:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890997.466085:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f55 expref: 9 pid: 6663 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.466133:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f55 expref: 9 pid: 6663 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.466161:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fa72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f55 expref: 9 pid: 6663 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.466245:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890997.466250:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890997.466263:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.466275:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.466308:0:6679:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890997.466322:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6679:1875787996266496:192.168.204.18@tcp:105: 00000100:00100000:3.0:1788890997.466367:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788890997.471925:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.472073:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6679:1875787996266496:192.168.204.18@tcp:105: 00010000:00010000:3.0:1788890997.472113:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890997.472145:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889536 00000100:00100000:0.0:1788890997.472154:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889536 00002000:00100000:0.0:1788890997.472221:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9da1f5337100 x1875787987889536/t0(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:48/0 lens 504/0 e 0 to 0 dl 1788891008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788890997.472226:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987889408:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 6184us (6370us total) trans 0 rc 0/0 00002000:00100000:0.0:1788890997.472242:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1f5337100 with x1875787987889536 ext(0->8) 00000100:00100000:3.0:1788890997.472246:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 68 00002000:00010000:0.0:1788890997.472250:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1f5337100 00000100:00100000:0.0:1788890997.472275:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:0.0:1788890997.472286:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987889536:12345-192.168.204.18@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788890997.473920:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2375:x1875787987889536:12345-192.168.204.18@tcp:4:lhsmtool_posix.0 Request processed in 1630us (2001us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788890997.473931:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 4 00002000:00100000:0.0:1788890997.473941:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9da1f5337100 x1875787987889536/t4294967314(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:48/0 lens 504/448 e 0 to 0 dl 1788891008 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788890997.473951:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1f5337100 with x1875787987889536 ext(0->8) 00002000:00010000:0.0:1788890997.473955:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1f5337100 00000100:00100000:2.0:1788890997.478866:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890997.478959:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889664 00000100:00100000:1.0:1788890997.478969:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889664 00000100:00100000:1.0:1788890997.479033:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 183 00000100:00100000:1.0:1788890997.479045:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:11528:x1875787987889664:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788890997.525443:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:11528:x1875787987889664:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 Request processed in 46387us (46574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890997.525461:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 183 00000001:00080000:0.0:1788890997.525836:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788890997.525860:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788890997.525900:0:5836:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788890997.525990:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788890997.526005:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788890997.526227:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788890997.526241:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996266624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788890997.526353:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890997.526444:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996266624 00000100:00100000:2.0:1788890997.526452:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996266624 00000100:00100000:2.0:1788890997.526562:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788890997.526572:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996266624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788890997.526723:0:11963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788890997.526727:0:11963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788890997 00002000:00010000:2.0:1788890997.526730:0:11963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788890997.526732:0:11963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788890997 -> 1788890997 00002000:00010000:2.0:1788890997.526735:0:11963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788890997.526768:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996266624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (416us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788890997.526781:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1788890997.526819:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da1f4d44000/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788890997.526824:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996266624:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788890997.526873:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788890997.529549:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.529649:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987889792 00000100:00100000:3.0:1788890997.529658:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987889792 00000100:00100000:3.0:1788890997.529795:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 55 00000100:00100000:3.0:1788890997.529805:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2373:x1875787987889792:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788890997.558394:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1788890997.558416:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788890997.558561:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987889792:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 Request processed in 28751us (29014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890997.558572:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 55 00000100:00100000:1.0:1788890997.563949:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.564202:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890048 00000100:00100000:3.0:1788890997.564215:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890048 00000100:00100000:3.0:1788890997.564281:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 184 00000100:00100000:3.0:1788890997.564293:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:11528:x1875787987890048:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788890997.564361:0:11412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890997.564397:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fa6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f4e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.564415:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:3.0:1788890997.564422:0:11412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788890997.564453:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.564466:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.564475:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788890997.564763:0:11412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098157388 reply state 000000005ec4ccb9 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890997.564791:0:11412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788890997.564901:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:11528:x1875787987890048:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 609us (961us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788890997.564909:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 184 00010000:00010000:0.0:1788890997.568912:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.568932:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.568940:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.568947:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.568952:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.568961:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.568978:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:0.0:1788890997.568981:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890997.568987:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.568993:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fa80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890997.570457:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.571150:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890176 00000100:00100000:3.0:1788890997.571160:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890176 00000100:00100000:0.0:1788890997.571286:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 56 00000100:00100000:0.0:1788890997.571299:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987890176:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788890997.571564:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788890997.571568:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788890997 -> 1788890997 00002000:00010000:0.0:1788890997.571571:0:6663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788890996 00002000:00010000:0.0:1788890997.571579:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788890997 -> 1788890997 00002000:00010000:0.0:1788890997.571581:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788890997.571640:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2373:x1875787987890176:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 344us (1190us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788890997.571648:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 56 00000100:00100000:3.0:1788890997.575920:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890997.576235:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890432 00000100:00100000:1.0:1788890997.576245:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890432 00000100:00100000:1.0:1788890997.576311:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 185 00000100:00100000:1.0:1788890997.576322:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:11528:x1875787987890432:12345-192.168.204.18@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788890997.576388:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.576406:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f40 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.576415:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.576457:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f40 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.576471:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f40 expref: 18 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890997.576486:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c34e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996266752:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788890997.576581:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700180 going to sleep for 11 seconds 00000100:00100000:3.0:1788890997.578856:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c34e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875787996266752:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890997.578884:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890997.580741:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.581041:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890560 00000100:00100000:0.0:1788890997.581051:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890560 00010000:00010000:0.0:1788890997.581090:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f40 expref: 19 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.581142:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 69 00000100:00100000:0.0:1788890997.581153:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:2374:x1875787987890560:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890997.581187:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890997.581197:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f40 expref: 19 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.581211:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f40 expref: 19 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.581232:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fa4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f40 expref: 19 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.581249:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:0.0:1788890997.581255:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.581274:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.581294:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.581445:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890997.581535:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:2374:x1875787987890560:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 384us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.581544:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 69 00010000:00010000:3.0:1788890997.581671:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.581679:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.581705:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.581712:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.581719:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.581725:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890997.581729:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.581745:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.581755:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:3.0:1788890997.581758:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788890997.581763:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.581769:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fa87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890997.581811:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:11528:x1875787987890432:12345-192.168.204.18@tcp:55:lhsmtool_posix.0 Request processed in 5491us (5898us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788890997.581819:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 185 00000100:00100000:1.0:1788890997.583723:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.583795:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890688 00000100:00100000:0.0:1788890997.583803:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890688 00000100:00100000:0.0:1788890997.583857:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 57 00000100:00100000:0.0:1788890997.583869:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2372:x1875787987890688:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788890997.583916:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.583936:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.583945:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890997.583949:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788890997.583954:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.583988:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.584003:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 8 pid: 6662 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.584037:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996266880:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890997.584157:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c58d1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788890997.589645:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.589793:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987890816 00000100:00100000:2.0:1788890997.589802:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987890816 00010000:00010000:2.0:1788890997.589843:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 9 pid: 6662 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890997.590034:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 70 00000100:00100000:2.0:1788890997.590044:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987890816:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890997.590059:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890997.590082:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 9 pid: 6662 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.590109:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 9 pid: 6662 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.590138:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890997.590143:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890997.590149:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.590159:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.590212:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890997.590277:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987890816:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 234us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890997.590284:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 70 00010000:00010000:3.0:1788890997.591567:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000681713f/0x9161b78f8ec3fa79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f5c expref: 8 pid: 6662 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890997.591638:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996266880:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890997.591664:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.591676:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.591683:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.591732:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.591739:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.591748:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.591755:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9a00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890997.591759:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.591769:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.591786:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.591794:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019580c45/0x9161b78f8ec3fa8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890997.591859:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2372:x1875787987890688:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 Request processed in 7992us (8144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890997.591867:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 57 00000100:00100000:3.0:1788890997.593609:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890997.593868:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891072 00000100:00100000:2.0:1788890997.593877:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891072 00000100:00100000:2.0:1788890997.593936:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 186 00000100:00100000:2.0:1788890997.593946:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+17:11528:x1875787987891072:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788890997.594026:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.594043:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.594054:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.594327:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.594339:0:6852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f47 expref: 18 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.594346:0:6852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.594380:0:6852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f47 expref: 18 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.594403:0:6852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f47 expref: 18 pid: 11412 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890997.594418:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996267008:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890997.594503:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0fafa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788890997.603024:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.604384:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996267008:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890997.604421:0:6852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.605288:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891200 00000100:00100000:0.0:1788890997.605297:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891200 00010000:00010000:0.0:1788890997.605336:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f47 expref: 19 pid: 11412 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.605380:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 71 00000100:00100000:0.0:1788890997.605390:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:2374:x1875787987891200:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890997.605404:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890997.605412:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f47 expref: 19 pid: 11412 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.605423:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f47 expref: 19 pid: 11412 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.605444:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fa5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f47 expref: 19 pid: 11412 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.605459:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:0.0:1788890997.605463:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.605492:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.605500:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.605525:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890997.605580:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:2374:x1875787987891200:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 191us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.605588:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 71 00010000:00010000:0.0:1788890997.605712:0:6852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.605720:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788890997.605914:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788890997.606077:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788890997.606142:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788890997.606260:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6852:1875787996267136:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788890997.606318:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890997.606346:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41cd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788890997.606366:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996267136 00000100:00100000:0.0:1788890997.606370:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996267136 00000100:00100000:0.0:1788890997.606400:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788890997.606408:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6852:x1875787996267136:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788890997.606477:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6852:x1875787996267136:12345-0@lo:1000:mdt00_003.0 Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.606484:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788890997.606524:0:6852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788890997.606529:0:6852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da1f4d44000, transno 4294967315 00000100:00100000:0.0:1788890997.606542:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6852:1875787996267136:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788890997.606991:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788890997.607047:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6852:1875787996267264:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788890997.607091:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890997.607126:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c58d1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788890997.607358:0:11998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996267264 00000100:00100000:0.0:1788890997.607363:0:11998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996267264 00000100:00100000:0.0:1788890997.607394:0:11998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890997.607402:0:11998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6852:x1875787996267264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788890997.607560:0:11998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6852:x1875787996267264:12345-0@lo:1000:mdt00_003.0 Request processed in 158us (468us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788890997.607568:0:11998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788890997.607610:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6852:1875787996267264:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788890997.607638:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607649:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607657:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607663:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.607668:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607676:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607699:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1c32fcf00) 00010000:00010000:0.0:1788890997.607702:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788890997.607707:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607713:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fa9c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607740:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607746:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607752:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607757:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890997.607760:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607765:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607772:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ce00) 00010000:00010000:0.0:1788890997.607775:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788890997.607778:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607783:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3f9d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607814:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607830:0:6852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f2b expref: 21 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607840:0:6852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607866:0:6852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f2b expref: 21 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890997.607880:0:6852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f2b expref: 21 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.607892:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb35180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996267392:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890997.607962:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8522000 going to sleep for 11 seconds 00000100:00100000:0.0:1788890997.612206:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb35180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996267392:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890997.612249:0:6852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.615437:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890997.616277:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891328 00000100:00100000:1.0:1788890997.616290:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891328 00010000:00010000:1.0:1788890997.616336:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f2b expref: 22 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890997.616384:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 72 00000100:00100000:1.0:1788890997.616395:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:2375:x1875787987891328:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890997.616410:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890997.616416:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f2b expref: 22 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616429:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f2b expref: 22 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616452:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3f9f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f2b expref: 22 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616479:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ce00) 00010000:00010000:1.0:1788890997.616484:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616493:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616500:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616528:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890997.616586:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:2375:x1875787987891328:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 192us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890997.616595:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 72 00010000:00010000:1.0:1788890997.616700:0:6852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616709:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616722:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616729:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616736:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616742:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890997.616753:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616761:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616770:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ce00) 00010000:00010000:1.0:1788890997.616773:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890997.616777:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616783:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3faa3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616794:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616801:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616807:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616813:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890997.616816:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616822:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616829:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870ce00) 00010000:00010000:1.0:1788890997.616831:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788890997.616841:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.616848:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fa95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890997.617082:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:11528:x1875787987891072:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 23136us (23480us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788890997.617090:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 186 00000020:00080000:1.0:1788890997.617094:0:6852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788890997.617235:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788890997.617241:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788890997.617705:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1788890997.617713:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788890997.625530:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.625681:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891584 00000100:00100000:3.0:1788890997.625692:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891584 00000100:00100000:3.0:1788890997.625759:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 50 00000100:00100000:3.0:1788890997.625772:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8c03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:11528:x1875787987891584:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788890997.627205:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788890997.627346:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788890997.627406:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.627430:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.627443:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.627453:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.627472:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.627481:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.627505:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788890997.627634:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8c03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:11528:x1875787987891584:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 1861us (2109us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788890997.627643:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 50 00000020:00080000:3.0:1788890997.627649:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788890997.627697:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890997.627706:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.627715:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edcc00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890997.627720:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.627729:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.627749:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9da1f5361300) 00010000:00010000:2.0:1788890997.627753:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788890997.627757:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.627762:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edcc00/0x9161b78f8ec3faaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890997.627780:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890997.627782:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890997.627784:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788890997.857559:0:12438:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788890997.857568:0:12438:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788890997.857619:0:12438:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788890997.857628:0:12438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788890997.878997:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890997.933993:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.934106:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891840 00000100:00100000:3.0:1788890997.934119:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891840 00000100:00100000:3.0:1788890997.934240:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 187 00000100:00100000:3.0:1788890997.934255:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:11538:x1875787987891840:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788890997.934285:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890997.934308:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f63 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.934409:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edde00/0x9161b78f8ec3fab8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.934424:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edde00/0x9161b78f8ec3fab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.934437:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edde00/0x9161b78f8ec3fab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890997.934447:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788890997.934574:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f63 expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.934591:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edde00/0x9161b78f8ec3fab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f63 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.934600:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:3.0:1788890997.934603:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788890997.934607:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edde00, rc 0) 00000100:00100000:3.0:1788890997.934713:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:11538:x1875787987891840:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 459us (728us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788890997.937600:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890997.937631:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987891968 00000100:00100000:1.0:1788890997.937639:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987891968 00000100:00100000:1.0:1788890997.937686:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 188 00000100:00100000:1.0:1788890997.937695:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11538:x1875787987891968:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:1.0:1788890997.937764:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.937781:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.937807:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.937823:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.937841:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.937849:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938066:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938075:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938082:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890997.938131:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938144:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938150:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938157:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938163:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fe00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890997.938187:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938196:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938216:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890997.938219:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890997.938224:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938230:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938241:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938247:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938253:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938258:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890997.938261:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938267:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938274:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c32fc400) 00010000:00010000:1.0:1788890997.938276:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890997.938279:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938285:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3facd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938308:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938314:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938320:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938325:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890997.938328:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938335:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938342:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fcd00) 00010000:00010000:1.0:1788890997.938344:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890997.938346:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.938352:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890997.938571:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11538:x1875787987891968:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 875us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890997.938580:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 188 00000100:00100000:3.0:1788890997.939061:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 187 00000100:00100000:3.0:1788890997.978102:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890997.978402:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892224 00000100:00100000:1.0:1788890997.978415:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892224 00000100:00100000:1.0:1788890997.978522:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 189 00000100:00100000:1.0:1788890997.978537:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:11541:x1875787987892224:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:1.0:1788890997.978564:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890997.978590:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fadb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f6a expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.978681:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.978695:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.978708:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.978723:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.978730:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.978736:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.978991:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979000:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979006:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890997.979016:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788890997.979126:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979133:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979145:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979153:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890997.979157:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979194:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979207:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890997.979210:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890997.979214:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979221:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979231:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979237:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979242:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979247:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fe00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890997.979250:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979265:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979273:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c32fcd00) 00010000:00010000:1.0:1788890997.979275:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890997.979278:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979284:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979326:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fadb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f6a expref: 27 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979340:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f6a expref: 26 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890997.979348:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:1.0:1788890997.979350:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788890997.979352:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f600, rc 0) 00000100:00100000:1.0:1788890997.979421:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11541:x1875787987892224:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 888us (1339us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788890997.979429:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 189 00000100:00100000:1.0:1788890997.981760:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890997.981842:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892352 00000100:00100000:3.0:1788890997.981851:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892352 00000100:00100000:3.0:1788890997.981938:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 190 00000100:00100000:3.0:1788890997.981949:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11541:x1875787987892352:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:3.0:1788890997.982004:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.982018:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.982029:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.982051:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.982059:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.982066:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.982073:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890997.982078:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.982086:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.982108:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:3.0:1788890997.982111:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788890997.982121:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890997.982128:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fafe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890997.982229:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11541:x1875787987892352:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 281us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890997.982236:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 190 00000100:00100000:1.0:1788890997.985366:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890997.985455:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892608 00000100:00100000:0.0:1788890997.985465:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892608 00000100:00100000:0.0:1788890997.985522:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:0.0:1788890997.985532:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11541:x1875787987892608:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:0.0:1788890997.985793:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:11541:x1875787987892608:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 261us (552us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788890997.985801:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:2.0:1788890998.014553:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.014741:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892864 00000100:00100000:0.0:1788890998.014752:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892864 00000100:00100000:0.0:1788890998.014978:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 191 00000100:00100000:0.0:1788890998.014990:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:11076:x1875787987892864:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:0.0:1788890998.015014:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890998.015035:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f71 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.015159:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.015191:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f6a expref: 28 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.015201:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.015237:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f6a expref: 28 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.015251:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f6a expref: 28 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.015276:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996267520:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890998.015371:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41cdf00 going to sleep for 11 seconds 00000100:00080000:2.0:1788890998.015425:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788890998.019355:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.019594:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996267520:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890998.019625:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890998.019708:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987892992 00000100:00100000:2.0:1788890998.019715:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987892992 00010000:00010000:2.0:1788890998.019753:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f6a expref: 29 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.019854:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 73 00000100:00100000:3.0:1788890998.019866:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:2375:x1875787987892992:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890998.019883:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890998.019891:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f6a expref: 29 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.019903:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f6a expref: 29 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.019926:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3faf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f6a expref: 29 pid: 6852 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.019939:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:3.0:1788890998.019943:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.019966:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.019972:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.020161:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890998.020232:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:2375:x1875787987892992:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 367us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.020240:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 73 00010000:00010000:0.0:1788890998.020466:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.020475:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890998.020504:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788890998.020701:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f71 expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.020719:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f71 expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.020726:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:0.0:1788890998.020729:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788890998.020731:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8a00, rc 0) 00000100:00100000:0.0:1788890998.020774:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:11076:x1875787987892864:12345-192.168.204.18@tcp:101:bash.0 Request processed in 5787us (6230us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788890998.020781:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 191 00000100:00100000:2.0:1788890998.023689:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.023759:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893248 00000100:00100000:0.0:1788890998.023769:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893248 00000100:00100000:0.0:1788890998.023862:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 192 00000100:00100000:0.0:1788890998.023872:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:11076:x1875787987893248:12345-192.168.204.18@tcp:36:bash.0 00010000:00010000:0.0:1788890998.024213:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.024230:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.024243:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788890998.024298:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788890998.024327:0:6852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5de2c17 reply state 0000000039b38ff7 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.024335:0:6852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788890998.024383:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788890998.024485:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:11076:x1875787987893248:12345-192.168.204.18@tcp:36:bash.0 Request processed in 614us (806us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788890998.024492:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 192 00000020:00080000:0.0:1788890998.024498:0:6852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788890998.028144:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.028163:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.028357:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.028364:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890998.028369:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.028377:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.028397:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:3.0:1788890998.028400:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890998.028406:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.028432:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890998.029082:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.029197:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893376 00000100:00100000:3.0:1788890998.029207:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893376 00000100:00100000:3.0:1788890998.029264:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 193 00000100:00100000:3.0:1788890998.029284:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:11076:x1875787987893376:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:3.0:1788890998.029309:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890998.029327:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fb21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f78 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.029445:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fb21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f78 expref: 32 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.029459:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fb21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f78 expref: 32 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.029480:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:3.0:1788890998.029483:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788890998.029486:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc200, rc 0) 00000100:00100000:3.0:1788890998.029554:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:11076:x1875787987893376:12345-192.168.204.18@tcp:101:bash.0 Request processed in 270us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.029562:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 193 00000100:00100000:2.0:1788890998.032257:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.032326:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893504 00000100:00100000:3.0:1788890998.032337:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893504 00000100:00100000:3.0:1788890998.032423:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 58 00000100:00100000:3.0:1788890998.032436:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:11076:x1875787987893504:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:3.0:1788890998.032487:0:11963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890998.032513:0:11963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f7f expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890998.032549:0:11963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa04f75, atime: 0x6aa04f74, ctime: 0x6aa04f75, blocks: 0xb 00010000:00010000:3.0:1788890998.032572:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=221s v=(0 0) 00010000:00010000:3.0:1788890998.032578:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890998.032587:0:11963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f7f expref: 8 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788890998.032594:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788890998.032606:0:11963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f7f expref: 8 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.032621:0:11963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edcc00, rc 0) 00000100:00100000:3.0:1788890998.032682:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:11076:x1875787987893504:12345-192.168.204.18@tcp:101:bash.0 Request processed in 250us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.032689:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 58 00000100:00100000:2.0:1788890998.034899:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.034992:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893632 00000100:00100000:0.0:1788890998.035002:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893632 00002000:00010000:0.0:1788890998.035052:0:6668:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788890998.035057:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1f4d45880 with x1875787987893632 ext(0->18446744073709551615) 00002000:00010000:0.0:1788890998.035071:0:6668:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1f4d45880. 00000100:00100000:0.0:1788890998.035119:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:0.0:1788890998.035131:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2373:x1875787987893632:12345-192.168.204.18@tcp:10:bash.0 00002000:00010000:0.0:1788890998.035564:0:6668:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788890998.035569:0:6668:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788890997 -> 1788890998 00002000:00010000:0.0:1788890998.035572:0:6668:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788890996 -> 1788890996 00002000:00010000:0.0:1788890998.035588:0:6668:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788890997 -> 1788890998 00002000:00010000:0.0:1788890998.035591:0:6668:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788890998.035655:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2373:x1875787987893632:12345-192.168.204.18@tcp:10:bash.0 Request processed in 525us (768us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788890998.035663:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00002000:00010000:0.0:1788890998.035667:0:6668:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788890998.035671:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1f4d45880 with x1875787987893632 ext(0->18446744073709551615) 00002000:00010000:0.0:1788890998.035940:0:6668:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1f4d45880. 00000100:00100000:2.0:1788890998.081975:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.082057:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987893760 00000100:00100000:0.0:1788890998.082067:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987893760 00000100:00100000:0.0:1788890998.082214:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 194 00000100:00100000:0.0:1788890998.082225:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:11555:x1875787987893760:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:0.0:1788890998.082292:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.082307:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.082319:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.082333:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.082340:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.082347:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082659:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082682:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082691:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890998.082732:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082751:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082758:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082765:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082772:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890998.082777:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082796:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082808:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890998.082812:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890998.082817:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082824:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082844:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082850:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082857:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082862:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890998.082865:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082871:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082879:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870cd00) 00010000:00010000:1.0:1788890998.082882:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890998.082885:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082892:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082906:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082912:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082919:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082930:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890998.082933:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082940:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082948:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:1.0:1788890998.082951:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890998.082954:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.082960:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fb3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890998.083042:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:11555:x1875787987893760:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 818us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890998.083051:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 194 00000100:00100000:2.0:1788890998.110873:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.110971:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894016 00000100:00100000:0.0:1788890998.110981:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894016 00000100:00100000:0.0:1788890998.111043:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 195 00000100:00100000:0.0:1788890998.111053:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+32:11558:x1875787987894016:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890998.111075:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890998.111110:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f86 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111229:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111245:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111256:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111271:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111278:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111284:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111526:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111535:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111548:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890998.111557:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788890998.111647:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111655:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111661:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111667:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890998.111671:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111678:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111690:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890998.111692:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890998.111696:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111702:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111712:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111718:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111730:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111735:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890998.111738:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111743:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111750:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870c400) 00010000:00010000:0.0:1788890998.111752:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890998.111754:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111760:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9600/0x9161b78f8ec3fb52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111794:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f86 expref: 35 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111807:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f86 expref: 34 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.111814:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:0.0:1788890998.111816:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788890998.111819:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9800, rc 0) 00000100:00100000:0.0:1788890998.111868:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:11558:x1875787987894016:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 817us (1005us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788890998.111883:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 195 00000100:00100000:3.0:1788890998.117438:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.118325:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894144 00000100:00100000:0.0:1788890998.118335:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894144 00000100:00100000:0.0:1788890998.118457:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 196 00000100:00100000:0.0:1788890998.118484:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:11558:x1875787987894144:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:0.0:1788890998.118551:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.118570:0:11412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f71 expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.118580:0:11412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.118616:0:11412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f71 expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.118631:0:11412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f71 expref: 34 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.118645:0:11412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fbb37480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996267648:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890998.118752:0:11412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41cdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890998.123148:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.123314:0:11412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fbb37480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996267648:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890998.123341:0:11412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.123732:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894400 00000100:00100000:3.0:1788890998.123740:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894400 00000100:00100000:3.0:1788890998.123834:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 52 00000100:00100000:3.0:1788890998.123845:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:6061:x1875787987894400:12345-192.168.204.18@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788890998.124195:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:6061:x1875787987894400:12345-192.168.204.18@tcp:35:ldlm_bl.0 Request processed in 351us (1057us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788890998.124203:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 52 00000100:00100000:1.0:1788890998.129675:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.131401:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894528 00000100:00100000:3.0:1788890998.131414:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894528 00010000:00010000:3.0:1788890998.131466:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f71 expref: 36 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.131519:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 74 00000100:00100000:3.0:1788890998.131530:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:2375:x1875787987894528:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890998.131553:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890998.131561:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f71 expref: 36 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.131587:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f71 expref: 36 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.131613:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8a00/0x9161b78f8ec3fb0c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f71 expref: 36 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.131631:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:3.0:1788890998.131636:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.131646:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.131654:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.131692:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890998.131811:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:2375:x1875787987894528:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 283us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.131833:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 74 00010000:00010000:1.0:1788890998.132123:0:11412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.132131:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.132162:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.132210:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.132228:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.132235:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890998.132239:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.132246:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.132256:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:1.0:1788890998.132259:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788890998.132271:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.132278:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8400/0x9161b78f8ec3fb67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890998.132318:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:11558:x1875787987894144:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 13838us (14890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890998.132326:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 196 00000100:00100000:2.0:1788890998.136465:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.136567:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987894784 00000100:00100000:0.0:1788890998.136589:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987894784 00000100:00100000:0.0:1788890998.136778:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 53 00000100:00100000:0.0:1788890998.136789:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+34:11558:x1875787987894784:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:0.0:1788890998.137039:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:11558:x1875787987894784:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 251us (585us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788890998.137047:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 53 00000100:00100000:2.0:1788890998.200908:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890998.201017:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895040 00000100:00100000:1.0:1788890998.201094:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895040 00000100:00100000:1.0:1788890998.201163:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 197 00000100:00100000:1.0:1788890998.201210:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+35:11569:x1875787987895040:12345-192.168.204.18@tcp:101:cat.0 00010000:00010000:1.0:1788890998.201235:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890998.201256:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fb6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f8d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201341:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201354:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201366:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201380:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201386:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201393:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201804:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fb83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201814:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fb83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201821:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fb83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890998.201830:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788890998.201916:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201924:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201936:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201943:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890998.201947:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201955:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201968:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890998.201971:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890998.201975:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201981:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fb75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201993:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.201999:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.202019:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.203609:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890998.203617:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.203647:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.203664:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c32fcd00) 00010000:00010000:1.0:1788890998.203666:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890998.203672:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.203679:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fb7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.203738:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fb6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f8d expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.203751:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fb83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f8d expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.203759:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:1.0:1788890998.203761:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788890998.203763:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f600, rc 0) 00000100:00100000:1.0:1788890998.203838:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11569:x1875787987895040:12345-192.168.204.18@tcp:101:cat.0 Request processed in 2630us (2939us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788890998.203846:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 197 00000100:00100000:1.0:1788890998.209737:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.209826:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895296 00000100:00100000:0.0:1788890998.209838:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895296 00000100:00100000:0.0:1788890998.209933:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 54 00000100:00100000:0.0:1788890998.209943:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11569:x1875787987895296:12345-192.168.204.18@tcp:35:cat.0 00000100:00100000:0.0:1788890998.210285:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:11569:x1875787987895296:12345-192.168.204.18@tcp:35:cat.0 Request processed in 343us (561us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788890998.210294:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 54 00000100:00100000:0.0:1788890998.232075:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890998.234618:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895552 00000100:00100000:1.0:1788890998.234638:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895552 00000100:00100000:0.0:1788890998.234871:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 198 00000100:00100000:0.0:1788890998.234883:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:11570:x1875787987895552:12345-192.168.204.18@tcp:36:rm.0 00010000:00010000:0.0:1788890998.234948:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788890998.234977:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fb83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f8d expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.235002:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fb59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f86 expref: 37 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.235016:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec3fb21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f78 expref: 36 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.235047:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c32fc400) 00010000:00010000:0.0:1788890998.235058:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890998.235081:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.235108:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.235118:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.235134:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.236212:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.236227:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.236576:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.236587:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.236595:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788890998.237327:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:0.0:1788890998.237389:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.237408:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.237417:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.237425:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.237431:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.237437:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.239654:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890998.239670:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.239682:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890998.239686:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.239696:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.239713:0:6678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870c000) 00010000:00010000:3.0:1788890998.239716:0:6678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788890998.239783:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.239795:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890998.239797:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890998.239799:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890998.239880:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788890998.239889:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fba6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.239926:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.239933:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.239940:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.239946:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890998.239950:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.239973:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.239984:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9da1c870c000) 00010000:00010000:0.0:1788890998.239986:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788890998.239990:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.240002:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fb9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.240025:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.240031:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.240038:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.240043:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890998.240045:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.240051:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.240059:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890998.240061:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890998.240064:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.240079:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fb91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890998.240103:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bc82812 reply state 00000000df33223a transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.240113:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788890998.240508:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+37:11570:x1875787987895552:12345-192.168.204.18@tcp:36:rm.0 Request processed in 5622us (8439us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788890998.240517:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 198 00010000:00010000:0.0:1788890998.243229:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.243250:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.243257:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.243264:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890998.243268:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.243276:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.243296:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870c400) 00010000:00010000:0.0:1788890998.243300:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890998.243305:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.243332:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fb98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.273857:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890998.278215:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895808 00000100:00100000:1.0:1788890998.278368:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895808 00000100:00100000:1.0:1788890998.278469:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 199 00000100:00100000:1.0:1788890998.278481:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+36:11576:x1875787987895808:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:1.0:1788890998.278507:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890998.278530:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fbad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f94 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.278657:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.278672:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.278684:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.278698:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.278704:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.278711:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788890998.279626:0:11412:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788890998.279807:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.279819:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.279828:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.279875:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.279883:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.279889:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.279895:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890998.279899:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.279908:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.279921:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890998.279925:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890998.279929:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.279936:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788890998.279948:0:11412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b57f358c reply state 0000000009ed7379 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890998.279957:0:11412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788890998.279987:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fbad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f94 expref: 39 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.280014:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f94 expref: 38 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.280591:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:1.0:1788890998.280595:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788890998.280598:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e000, rc 0) 00000100:00100000:1.0:1788890998.280695:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:11576:x1875787987895808:12345-192.168.204.18@tcp:101:bash.0 Request processed in 2215us (6848us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788890998.280705:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 199 00010000:00010000:3.0:1788890998.282933:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.282952:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.282959:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.282966:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890998.282971:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.282994:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.283013:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c32fcd00) 00010000:00010000:3.0:1788890998.283016:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890998.283022:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.283028:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fbbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.286624:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.286893:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987895936 00000100:00100000:3.0:1788890998.286903:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987895936 00000100:00100000:3.0:1788890998.286972:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 59 00000100:00100000:3.0:1788890998.286983:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987895936:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:3.0:1788890998.287002:0:6664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890998.287023:0:6664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1f9b expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890998.287051:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788890998.287071:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=222s v=(0 0) 00010000:00010000:3.0:1788890998.287075:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890998.287098:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f9b expref: 8 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.287118:0:6664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f9b expref: 8 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.287147:0:6664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4eddc00, rc 0) 00000100:00100000:3.0:1788890998.287232:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2373:x1875787987895936:12345-192.168.204.18@tcp:101:bash.0 Request processed in 251us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.287239:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 59 00000100:00080000:2.0:1788890998.287567:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788890998.295786:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.295887:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896064 00000100:00100000:0.0:1788890998.295897:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896064 00000100:00100000:0.0:1788890998.295959:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:0.0:1788890998.295970:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:11576:x1875787987896064:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:0.0:1788890998.295990:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890998.296012:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fa2 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.296051:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f9b expref: 9 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.296059:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890998.296064:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890998.296069:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 9 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.296116:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f9b expref: 9 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.296129:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f9b expref: 9 pid: 6664 timeout: 322 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.296163:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffa7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6663:1875787996267776:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890998.296306:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890998.299594:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffa7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6663:1875787996267776:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890998.299629:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 9 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.299650:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8200, rc 0) 00000100:00100000:0.0:1788890998.299705:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:11576:x1875787987896064:12345-192.168.204.18@tcp:101:bash.0 Request processed in 3736us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.299714:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:1.0:1788890998.300011:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.301353:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896192 00000100:00100000:3.0:1788890998.301365:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896192 00010000:00010000:3.0:1788890998.301408:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f9b expref: 9 pid: 6664 timeout: 322 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.301522:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:3.0:1788890998.301534:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2374:x1875787987896192:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890998.301550:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890998.301575:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f9b expref: 9 pid: 6664 timeout: 322 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.301589:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f9b expref: 9 pid: 6664 timeout: 322 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.301611:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fbd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f9b expref: 9 pid: 6664 timeout: 322 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.301627:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890998.301631:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890998.301640:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.301665:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.301705:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.301740:0:5799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f5334700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1875787996267904:192.168.204.18@tcp:105: 00000100:00100000:3.0:1788890998.301822:0:5799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681000 going to sleep for 11 seconds 00000100:00100000:3.0:1788890998.308163:0:5799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f5334700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5799:1875787996267904:192.168.204.18@tcp:105: 00010000:00010000:3.0:1788890998.308232:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890998.308809:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2374:x1875787987896192:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 7274us (8794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.308822:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:1.0:1788890998.315232:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.315510:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896448 00000100:00100000:3.0:1788890998.315521:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896448 00000100:00100000:3.0:1788890998.315636:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 55 00000100:00100000:3.0:1788890998.315647:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+38:11576:x1875787987896448:12345-192.168.204.18@tcp:35:bash.0 00000100:00100000:3.0:1788890998.316024:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:11576:x1875787987896448:12345-192.168.204.18@tcp:35:bash.0 Request processed in 378us (803us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788890998.316032:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 55 00000100:00100000:2.0:1788890998.408613:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890998.408778:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896576 00000100:00100000:1.0:1788890998.408788:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896576 00000100:00100000:1.0:1788890998.408886:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 200 00000100:00100000:1.0:1788890998.408898:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+39:11592:x1875787987896576:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:1.0:1788890998.408925:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890998.408947:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fbde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fa9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.409013:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.409028:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.409039:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890998.409108:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788890998.409112:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788890998.409134:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.409164:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fbde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa9 expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.409305:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa9 expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.409315:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890998.409318:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788890998.409321:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f000, rc 0) 00000100:00100000:1.0:1788890998.409389:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:11592:x1875787987896576:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 494us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890998.409396:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 200 00000100:00100000:2.0:1788890998.422616:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.423143:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987896832 00000100:00100000:0.0:1788890998.423153:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987896832 00000100:00100000:0.0:1788890998.423250:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 201 00000100:00100000:0.0:1788890998.423261:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+40:11592:x1875787987896832:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890998.423287:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890998.423308:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fbec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fb0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.423431:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fbf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.423445:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.423456:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890998.423484:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788890998.423640:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9200/0x9161b78f8ec3fbec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fb0 expref: 43 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.423660:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fb0 expref: 42 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.423669:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:0.0:1788890998.423672:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788890998.423676:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8c00, rc 0) 00000100:00100000:0.0:1788890998.423750:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:11592:x1875787987896832:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 490us (1145us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788890998.423758:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 201 00000100:00100000:3.0:1788890998.429689:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890998.429792:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897088 00000100:00100000:1.0:1788890998.429807:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897088 00000100:00100000:1.0:1788890998.429868:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 202 00000100:00100000:1.0:1788890998.429878:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+42:11592:x1875787987897088:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:1.0:1788890998.429900:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890998.429922:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fc01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fb7 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.430028:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.430060:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.430073:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890998.430102:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788890998.430277:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fc01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fb7 expref: 45 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.430295:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fb7 expref: 44 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.430303:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:1.0:1788890998.430306:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788890998.430309:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f600, rc 0) 00000100:00100000:1.0:1788890998.430366:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+44:11592:x1875787987897088:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 489us (688us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788890998.430373:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 202 00000100:00100000:2.0:1788890998.430852:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.431193:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897216 00000100:00100000:3.0:1788890998.431199:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897216 00000100:00100000:3.0:1788890998.431253:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00100000:3.0:1788890998.431271:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+44:2375:x1875787987897216:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890998.431282:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890998.431298:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8c00/0x9161b78f8ec3fbf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fb0 expref: 44 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.431311:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:3.0:1788890998.431314:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788890998.431349:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+43:2375:x1875787987897216:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 81us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.431356:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00100000:0.0:1788890998.436045:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.436226:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897344 00000100:00100000:3.0:1788890998.436250:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897344 00000100:00100000:3.0:1788890998.436301:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:3.0:1788890998.436323:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987897344:12345-192.168.204.18@tcp:1:lfs.0 00010000:00010000:3.0:1788890998.436377:0:6664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.436401:0:6664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.436410:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890998.436415:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788890998.436419:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.436478:0:6664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.436515:0:6664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 8 pid: 6663 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.436531:0:6664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6664:1875787996268032:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890998.436648:0:6664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681000 going to sleep for 11 seconds 00000100:00100000:3.0:1788890998.439856:0:6664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6664:1875787996268032:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788890998.439893:0:6664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.441916:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.442028:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897472 00000100:00100000:3.0:1788890998.442038:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897472 00002000:00100000:3.0:1788890998.442109:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9da1ffa7bb80 x1875787987897472/t0(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:49/0 lens 504/0 e 0 to 0 dl 1788891009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788890998.442121:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1ffa7bb80 with x1875787987897472 ext(0->8) 00010000:00010000:3.0:1788890998.442132:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 9 pid: 6663 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.442150:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 9 pid: 6663 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890998.442163:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9da1ffa7bb80 00000100:00100000:3.0:1788890998.442246:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:3.0:1788890998.442257:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2374:x1875787987897472:12345-192.168.204.18@tcp:4:lfs.0 00000100:00100000:3.0:1788890998.443667:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:2374:x1875787987897472:12345-192.168.204.18@tcp:4:lfs.0 Request processed in 1404us (1756us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788890998.443681:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 3 00002000:00100000:3.0:1788890998.443691:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9da1ffa7bb80 x1875787987897472/t4294967308(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:49/0 lens 504/448 e 0 to 0 dl 1788891009 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788890998.443702:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1ffa7bb80 with x1875787987897472 ext(0->8) 00010000:00010000:3.0:1788890998.443710:0:6667:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 11 pid: 6663 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.443727:0:6667:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 11 pid: 6663 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788890998.443734:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9da1ffa7bb80 00000100:00100000:1.0:1788890998.447370:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.447502:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897600 00000100:00100000:0.0:1788890998.447516:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897600 00010000:00010000:0.0:1788890998.447562:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 11 pid: 6663 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.447671:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 76 00000100:00100000:0.0:1788890998.447683:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:2375:x1875787987897600:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890998.447698:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788890998.447717:0:5801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788890998.447720:0:5801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788890998 00002000:00010000:0.0:1788890998.447722:0:5801:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788890998 00002000:00010000:0.0:1788890998.447737:0:5801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788890998 00010000:00010000:0.0:1788890998.447745:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 11 pid: 6663 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.447760:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 11 pid: 6663 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.447801:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec3fbd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa2 expref: 11 pid: 6663 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.447818:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788890998.447823:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788890998.447829:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.447839:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.447875:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890998.447943:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2375:x1875787987897600:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 263us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.447956:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 76 00010000:00010000:3.0:1788890998.448023:0:6664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.448034:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.448061:0:6664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.448070:0:6664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.448100:0:6664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.448108:0:6664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4eddc00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890998.448114:0:6664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.448123:0:6664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.448135:0:6664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.448143:0:6664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe95d618/0x9161b78f8ec3fc16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.448248:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987897344:12345-192.168.204.18@tcp:1:lfs.0 Request processed in 11928us (12214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.448257:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:1.0:1788890998.454152:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.454387:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897856 00000100:00100000:0.0:1788890998.454399:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897856 00000100:00100000:0.0:1788890998.454463:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 56 00000100:00100000:0.0:1788890998.454474:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d03bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+43:11592:x1875787987897856:12345-192.168.204.18@tcp:35:lfs.0 00000004:00010000:0.0:1788890998.454683:0:5817:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fb7 expref: 43 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788890998.455040:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788890998.455105:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788890998.455861:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788890998.455924:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.455942:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f94 expref: 47 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.455951:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.455985:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f94 expref: 47 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.456002:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f94 expref: 47 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.456017:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffa78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875787996268160:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890998.456113:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788890998.457756:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffa78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875787996268160:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890998.457782:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890998.458469:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.458602:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987897984 00000100:00100000:3.0:1788890998.458610:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987897984 00010000:00010000:3.0:1788890998.458648:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f94 expref: 48 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.458698:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 77 00000100:00100000:3.0:1788890998.458723:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+48:2374:x1875787987897984:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890998.458737:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890998.458752:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f94 expref: 48 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.458765:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f94 expref: 48 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.458787:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fbc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f94 expref: 48 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.458802:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:3.0:1788890998.458807:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.458816:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.458824:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.458851:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890998.458869:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.458880:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.458943:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+47:2374:x1875787987897984:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 221us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.458952:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 77 00000001:00080000:0.0:1788890998.459039:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788890998.459313:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788890998.459422:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffa78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875787996268288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788890998.459473:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788890998.459513:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da0c1102c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788890998.459575:0:11998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996268288 00000100:00100000:1.0:1788890998.459581:0:11998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996268288 00000100:00100000:1.0:1788890998.459642:0:11998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788890998.459652:0:11998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5817:x1875787996268288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788890998.459822:0:11998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5817:x1875787996268288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 171us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890998.459837:0:11998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788890998.459895:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788890998.459942:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffa78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875787996268288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788890998.460689:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788890998.460761:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875787996268416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788890998.460802:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890998.460864:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf480 going to sleep for 11 seconds 00000100:00100000:0.0:1788890998.460906:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996268416 00000100:00100000:0.0:1788890998.460911:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996268416 00000100:00100000:0.0:1788890998.460977:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788890998.460986:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5817:x1875787996268416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788890998.461150:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5817:x1875787996268416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 165us (347us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788890998.461157:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788890998.461519:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875787996268416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788890998.461590:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788890998.461654:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.461669:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.461678:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.461686:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890998.461690:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.461698:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.461719:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:3.0:1788890998.461722:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788890998.461729:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.461741:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8800/0x9161b78f8ec3fc1d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788890998.461993:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788890998.462345:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788890998.462359:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 222311190103ns, next at 223311187669ns, rc = 0 00000001:00080000:3.0:1788890998.462367:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788890998.462408:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1c32fce00) 00010000:00010000:3.0:1788890998.462412:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788890998.462420:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fb7 expref: 51 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.463162:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d03bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+50:11592:x1875787987897856:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 8688us (9020us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788890998.463619:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 56 00000020:00080000:3.0:1788890998.463626:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788890998.465908:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.468015:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898112 00000100:00100000:3.0:1788890998.468029:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898112 00000100:00100000:3.0:1788890998.468107:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 203 00000100:00100000:3.0:1788890998.468116:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+50:11592:x1875787987898112:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788890998.468153:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890998.468191:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fc24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fbe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.468271:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fc24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fbe expref: 51 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.468290:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fc24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fbe expref: 51 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.468310:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:3.0:1788890998.468314:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788890998.468319:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4eddc00, rc 0) 00000100:00100000:2.0:1788890998.468568:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+51:11592:x1875787987898112:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 452us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890998.468577:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 203 00000100:00100000:2.0:1788890998.471615:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.471709:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898368 00000100:00100000:3.0:1788890998.471730:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898368 00000100:00100000:3.0:1788890998.471795:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 57 00000100:00100000:3.0:1788890998.471806:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+51:11592:x1875787987898368:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890998.472051:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:11592:x1875787987898368:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 247us (448us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788890998.472075:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 57 00000100:00100000:1.0:1788890998.531164:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.531349:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898496 00000100:00100000:0.0:1788890998.531359:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898496 00000100:00100000:0.0:1788890998.531419:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 204 00000100:00100000:0.0:1788890998.531431:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:11602:x1875787987898496:12345-192.168.204.18@tcp:34:lfs.0 00010000:00010000:0.0:1788890998.531509:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531527:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531539:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531556:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531584:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531592:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531675:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531684:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531692:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788890998.531731:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531743:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531750:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531758:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531764:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890998.531769:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531777:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531797:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890998.531800:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890998.531805:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531812:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531825:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531832:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531838:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531843:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890998.531846:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531852:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531860:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870c400) 00010000:00010000:0.0:1788890998.531862:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890998.531865:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531871:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9800/0x9161b78f8ec3fc32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531893:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531899:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531906:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531911:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890998.531914:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531921:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531928:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:0.0:1788890998.531930:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890998.531933:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.531939:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9000/0x9161b78f8ec3fc39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.532136:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:11602:x1875787987898496:12345-192.168.204.18@tcp:34:lfs.0 Request processed in 705us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.532145:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 204 00000100:00100000:1.0:1788890998.567518:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890998.567640:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898752 00000100:00100000:2.0:1788890998.567651:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898752 00000100:00100000:2.0:1788890998.567717:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 205 00000100:00100000:2.0:1788890998.567728:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+52:11605:x1875787987898752:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890998.567749:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890998.567771:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3fc40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fc5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.567909:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.567924:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.567934:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.567947:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.567954:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.567961:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568276:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568301:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568309:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890998.568319:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788890998.568416:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568424:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568431:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568438:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890998.568442:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568449:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568461:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890998.568464:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890998.568468:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568474:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568487:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568499:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568505:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568510:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890998.568513:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568519:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568528:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890998.568530:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890998.568533:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568539:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568581:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86600/0x9161b78f8ec3fc40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fc5 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568594:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fc5 expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.568602:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788890998.568604:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890998.568613:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87800, rc 0) 00000100:00100000:2.0:1788890998.568725:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:11605:x1875787987898752:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 999us (1216us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788890998.568734:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 205 00000100:00100000:2.0:1788890998.571512:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890998.571618:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987898880 00000100:00100000:1.0:1788890998.571629:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987898880 00000100:00100000:1.0:1788890998.571758:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 206 00000100:00100000:1.0:1788890998.571769:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:11605:x1875787987898880:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:1.0:1788890998.571844:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.571859:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.571871:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.571895:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.571902:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.571908:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.571914:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890998.571919:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.571945:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.571958:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:1.0:1788890998.571961:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788890998.571966:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.571973:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890998.572054:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:11605:x1875787987898880:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 287us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890998.572071:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 206 00000100:00100000:1.0:1788890998.574024:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.574614:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899136 00000100:00100000:3.0:1788890998.574623:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899136 00000100:00100000:3.0:1788890998.574717:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 58 00000100:00100000:3.0:1788890998.574728:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+54:11605:x1875787987899136:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788890998.574973:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:11605:x1875787987899136:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 246us (956us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788890998.574981:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 58 00000100:00100000:3.0:1788890998.638542:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890998.638648:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899392 00000100:00100000:1.0:1788890998.638659:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899392 00000100:00100000:1.0:1788890998.638740:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 207 00000100:00100000:1.0:1788890998.638751:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:11615:x1875787987899392:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:1.0:1788890998.638778:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890998.638782:0:11412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788890998.638812:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f000/0x9161b78f8ec3fbe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fa9 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.638834:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890998.638840:0:11412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890998.638857:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fcc expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.638994:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.639009:0:11412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fc5 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.639017:0:11412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.639054:0:11412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fc5 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.639067:0:11412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fc5 expref: 55 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890998.639095:0:11412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c34e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996268544:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788890998.639265:0:11412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700000 going to sleep for 11 seconds 00000100:00100000:1.0:1788890998.642158:0:11412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c34e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11412:1875787996268544:192.168.204.18@tcp:104: 00010000:00010000:1.0:1788890998.642214:0:11412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.643471:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890998.643851:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899520 00000100:00100000:2.0:1788890998.643861:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899520 00010000:00010000:2.0:1788890998.643910:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fc5 expref: 56 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890998.644006:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 78 00000100:00100000:2.0:1788890998.644017:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+56:2374:x1875787987899520:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890998.644032:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890998.644040:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fc5 expref: 56 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.644054:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fc5 expref: 56 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.644089:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fc5 expref: 56 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.644107:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788890998.644112:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.644123:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.644150:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.644220:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890998.644293:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:2374:x1875787987899520:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 276us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890998.644301:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 78 00010000:00010000:1.0:1788890998.644370:0:11412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.644380:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890998.644400:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788890998.644823:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f600/0x9161b78f8ec3fc6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fcc expref: 56 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.644844:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fcc expref: 55 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890998.644853:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:1.0:1788890998.644856:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788890998.644859:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e600, rc 0) 00000100:00100000:1.0:1788890998.644901:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:11615:x1875787987899392:12345-192.168.204.18@tcp:101:bash.0 Request processed in 6152us (6370us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788890998.644909:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 207 00000100:00100000:3.0:1788890998.650112:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890998.650910:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899776 00000100:00100000:2.0:1788890998.650925:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899776 00000100:00100000:2.0:1788890998.650994:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 208 00000100:00100000:2.0:1788890998.651004:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+55:11615:x1875787987899776:12345-192.168.204.18@tcp:36:bash.0 00010000:00010000:2.0:1788890998.651368:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.651390:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.651405:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890998.651467:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788890998.651495:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048539a23 reply state 00000000292cead3 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890998.651505:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788890998.651759:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+58:11615:x1875787987899776:12345-192.168.204.18@tcp:36:bash.0 Request processed in 754us (1660us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788890998.651767:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 208 00000020:00080000:2.0:1788890998.651773:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788890998.655561:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890998.655771:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987899904 00000100:00100000:2.0:1788890998.655782:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987899904 00000100:00100000:2.0:1788890998.655842:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 209 00000100:00100000:2.0:1788890998.655853:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+58:11615:x1875787987899904:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788890998.655877:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890998.655898:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fd3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.655985:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.656000:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fcc expref: 59 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.656007:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.656015:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.656033:0:5816:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.656058:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fcc expref: 59 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.656072:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fcc expref: 59 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890998.656098:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996268672:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890998.656214:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0fafc00 going to sleep for 11 seconds 00010000:00010000:3.0:1788890998.656633:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.656643:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.656651:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.656657:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890998.656660:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.656667:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.656683:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:3.0:1788890998.656745:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890998.656748:0:3265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.656759:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.656765:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fc7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.660571:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.660647:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900032 00000100:00100000:0.0:1788890998.660657:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900032 00010000:00010000:0.0:1788890998.660713:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fcc expref: 59 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890998.660751:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 79 00000100:00100000:0.0:1788890998.660762:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:2375:x1875787987900032:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890998.660776:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890998.660784:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fcc expref: 59 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.660797:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fcc expref: 59 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.660819:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:0.0:1788890998.660824:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.660833:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.660840:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.660858:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890998.660920:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:2375:x1875787987900032:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 159us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.660928:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 79 00010000:00010000:2.0:1788890998.661950:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fc71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fcc expref: 58 pid: 11412 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890998.661970:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996268672:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890998.661992:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.662002:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.662008:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890998.662051:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788890998.662056:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890998.662074:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.663275:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fc86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fd3 expref: 58 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.663294:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fd3 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.663304:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788890998.663307:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890998.663311:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86400, rc 0) 00000100:00100000:2.0:1788890998.663390:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+57:11615:x1875787987899904:12345-192.168.204.18@tcp:101:bash.0 Request processed in 7539us (7845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890998.663415:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 209 00000100:00100000:3.0:1788890998.667812:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890998.667897:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900288 00000100:00100000:2.0:1788890998.667910:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900288 00000100:00100000:2.0:1788890998.667977:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 59 00000100:00100000:2.0:1788890998.667987:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+57:11615:x1875787987900288:12345-192.168.204.18@tcp:35:bash.0 00000100:00100000:2.0:1788890998.669031:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+58:11615:x1875787987900288:12345-192.168.204.18@tcp:35:bash.0 Request processed in 1040us (1226us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788890998.669042:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 59 00000100:00100000:1.0:1788890998.722948:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.723121:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900416 00000100:00100000:0.0:1788890998.723130:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900416 00000100:00100000:0.0:1788890998.723229:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 210 00000100:00100000:0.0:1788890998.723255:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+58:11621:x1875787987900416:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890998.723279:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890998.723301:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fda expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.723370:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fc9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.723386:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fc9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.723398:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fc9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890998.723433:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788890998.723437:0:11412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890998.723651:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fc9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.723677:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fc94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fda expref: 60 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.723708:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fc9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fda expref: 59 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.723718:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788890998.723721:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788890998.723725:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8000, rc 0) 00000100:00100000:0.0:1788890998.723854:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:11621:x1875787987900416:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 601us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.723871:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 210 00000100:00100000:1.0:1788890998.727633:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890998.727778:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900544 00000100:00100000:2.0:1788890998.727788:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900544 00000100:00100000:2.0:1788890998.727891:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 211 00000100:00100000:2.0:1788890998.727903:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:11621:x1875787987900544:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890998.727924:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890998.727947:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fca2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fe1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728021:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728036:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728049:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728065:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728094:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728102:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728244:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fcb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728253:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728260:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890998.728298:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788890998.728302:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788890998.728324:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728338:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728346:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728353:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728360:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728376:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890998.728380:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728388:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728400:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890998.728403:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890998.728409:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728414:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728430:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728435:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728454:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728459:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890998.728461:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728466:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728484:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c2aee400) 00010000:00010000:2.0:1788890998.728487:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890998.728490:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728496:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728531:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fca2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe1 expref: 61 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728543:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe1 expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.728550:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788890998.728552:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788890998.728554:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86e00, rc 0) 00000100:00100000:2.0:1788890998.728611:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:11621:x1875787987900544:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 711us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890998.728618:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 211 00000100:00100000:3.0:1788890998.731888:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.732004:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900672 00000100:00100000:0.0:1788890998.732014:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900672 00000100:00100000:0.0:1788890998.732093:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:0.0:1788890998.732104:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:2373:x1875787987900672:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890998.732123:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890998.732152:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fcb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe1 expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.732226:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:0.0:1788890998.732233:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890998.732296:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:2373:x1875787987900672:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 194us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.732304:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:1.0:1788890998.732886:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890998.733136:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987900928 00000100:00100000:2.0:1788890998.733143:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987900928 00000100:00100000:2.0:1788890998.733217:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 212 00000100:00100000:2.0:1788890998.733227:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:11621:x1875787987900928:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890998.733255:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890998.733272:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fe8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.733399:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.733413:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fd3 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.733421:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.733467:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fd3 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.733480:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fd3 expref: 60 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890998.733494:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996268800:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890998.733574:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0fafc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788890998.737425:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875787996268800:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890998.737464:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890998.738290:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890998.739217:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901056 00000100:00100000:3.0:1788890998.739227:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901056 00010000:00010000:3.0:1788890998.739277:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fd3 expref: 61 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890998.739317:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 80 00000100:00100000:3.0:1788890998.739360:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:2374:x1875787987901056:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788890998.739379:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788890998.739388:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fd3 expref: 61 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.739403:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fd3 expref: 61 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.739425:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fc8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fd3 expref: 61 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.739461:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:3.0:1788890998.739467:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.739477:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.739484:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890998.739560:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890998.739561:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.739568:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890998.739587:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:3.0:1788890998.739629:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:2374:x1875787987901056:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 303us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890998.739637:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 80 00010000:00010000:2.0:1788890998.739755:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe8 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.739771:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe8 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.739778:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788890998.739781:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788890998.739783:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87200, rc 0) 00000100:00100000:2.0:1788890998.739808:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:11621:x1875787987900928:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 6583us (6925us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788890998.739815:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 212 00000100:00100000:1.0:1788890998.742461:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.743545:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901312 00000100:00100000:0.0:1788890998.743558:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901312 00000100:00100000:0.0:1788890998.743633:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:0.0:1788890998.743645:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:11621:x1875787987901312:12345-192.168.204.18@tcp:103:lfs.0 00010000:00010000:0.0:1788890998.743661:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890998.743687:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4eddc00/0x9161b78f8ec3fc24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fbe expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.743709:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:0.0:1788890998.743726:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890998.743791:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:11621:x1875787987901312:12345-192.168.204.18@tcp:103:lfs.0 Request processed in 149us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.743817:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:1.0:1788890998.746630:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890998.746674:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901440 00000100:00100000:0.0:1788890998.746682:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901440 00000100:00100000:0.0:1788890998.746798:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 213 00000100:00100000:0.0:1788890998.746810:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:11621:x1875787987901440:12345-192.168.204.18@tcp:58:lfs.0 00010000:00010000:0.0:1788890998.746914:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.746933:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890998.746944:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788890998.747157:0:11412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788890998.747435:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:11621:x1875787987901440:12345-192.168.204.18@tcp:58:lfs.0 Request processed in 627us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.747444:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 213 00000100:00100000:1.0:1788890998.751152:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890998.751285:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901568 00000100:00100000:2.0:1788890998.751294:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901568 00000100:00100000:2.0:1788890998.751411:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 214 00000100:00100000:2.0:1788890998.751421:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+59:11621:x1875787987901568:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788890998.751442:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890998.751471:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1fef expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.751532:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.751543:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcda lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fef expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.751562:0:5815:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.751599:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcda lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fef expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.751613:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788890998.751616:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890998.751620:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcda lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fef expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890998.751627:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87a00, rc 0) 00000100:00100000:2.0:1788890998.751685:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:11621:x1875787987901568:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 266us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890998.752388:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 214 00000100:00100000:2.0:1788890998.838928:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996268928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788890998.839008:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788890998.839232:0:6851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 222688062164ns, next at 223688059131ns, rc = 0 00000100:00100000:0.0:1788890998.839276:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996268928 00000100:00100000:0.0:1788890998.839285:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996268928 00000100:00100000:0.0:1788890998.839339:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788890998.839350:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996268928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788890998.839375:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788890998.846497:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996268928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7138us (7476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890998.846513:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788890998.849326:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996268928:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788890998.877145:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788890998.877208:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1788890998.902504:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788890999.670688:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788890999.670699:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788890999.670759:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 6 00000040:00080000:1.0:1788890999.670769:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788890999.671250:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c34e2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996269056:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788890999.671358:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c57000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890999.674106:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c34e2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996269056:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788890999.677791:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.677974:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901696 00000100:00100000:2.0:1788890999.677988:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901696 00000100:00100000:2.0:1788890999.678075:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 215 00000100:00100000:2.0:1788890999.678089:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c34e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:11622:x1875787987901696:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788890999.678138:0:5816:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788890999.678940:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c34e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:11622:x1875787987901696:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 846us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.678988:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 215 00000100:00100000:1.0:1788890999.686316:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.687034:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987901824 00000100:00100000:0.0:1788890999.687050:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987901824 00000100:00100000:0.0:1788890999.687149:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 216 00000100:00100000:0.0:1788890999.687163:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:11622:x1875787987901824:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788890999.687292:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687315:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687333:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687354:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687361:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687369:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687398:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687407:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687413:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788890999.687489:0:11412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788890999.687495:0:11412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788890999.687511:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687525:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687533:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687541:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687548:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890999.687553:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687562:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687578:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:0.0:1788890999.687581:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890999.687588:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687595:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fce1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687611:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687628:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687635:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687640:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890999.687643:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687650:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687659:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9da1c870c400) 00010000:00010000:0.0:1788890999.687661:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890999.687665:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687671:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fce8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687688:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687694:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687701:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687707:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890999.687716:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687724:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687734:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:0.0:1788890999.687736:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788890999.687740:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.687747:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9e00/0x9161b78f8ec3fcef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890999.689193:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:11622:x1875787987901824:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 Request processed in 2006us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.689210:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 216 00000100:00100000:0.0:1788890999.692922:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.693013:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902080 00000100:00100000:2.0:1788890999.693025:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902080 00000100:00100000:2.0:1788890999.693118:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 217 00000100:00100000:2.0:1788890999.693128:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+60:11622:x1875787987902080:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788890999.693153:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890999.693203:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fcf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ff6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.693338:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.693369:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.693383:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788890999.693399:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788890999.694623:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.694639:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.694646:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.694652:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890999.694657:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.694683:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.694702:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788890999.694706:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788890999.694713:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.694720:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fcfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.694932:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fcf6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ff6 expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.694947:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:2.0:1788890999.694950:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788890999.694954:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fcf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ff6 expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.694965:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87800, rc 0) 00000100:00100000:2.0:1788890999.695067:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:11622:x1875787987902080:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 1926us (2147us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788890999.695077:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 217 00000100:00100000:1.0:1788890999.700151:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.704852:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902208 00000100:00100000:2.0:1788890999.704874:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902208 00000100:00100000:2.0:1788890999.704986:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 218 00000100:00100000:2.0:1788890999.705012:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:11622:x1875787987902208:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788890999.705105:0:5816:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788890999.705311:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:11622:x1875787987902208:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 302us (5172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.705320:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 218 00000100:00100000:1.0:1788890999.710347:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890999.711211:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902464 00000100:00100000:1.0:1788890999.711223:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902464 00000100:00100000:1.0:1788890999.711300:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 219 00000100:00100000:1.0:1788890999.711310:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:11622:x1875787987902464:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788890999.711333:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788890999.711337:0:11412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788890999.711366:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fc9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fda expref: 61 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.711389:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890999.711395:0:11412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788890999.711411:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fd0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a1ffd expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788890999.712289:0:11412:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788890999.712551:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fd12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.712566:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fd12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.712577:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fd12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.712646:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fd0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ffd expref: 63 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.712664:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fd12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ffd expref: 62 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.712688:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c32fcd00) 00010000:00010000:1.0:1788890999.712691:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788890999.712694:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e000, rc 0) 00000100:00100000:1.0:1788890999.712778:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+62:11622:x1875787987902464:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 1468us (2441us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788890999.712787:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 219 00000100:00100000:0.0:1788890999.717254:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.717951:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902720 00000100:00100000:2.0:1788890999.717965:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902720 00000100:00100000:2.0:1788890999.718033:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 220 00000100:00100000:2.0:1788890999.718044:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+62:11622:x1875787987902720:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788890999.718114:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890999.718143:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec3fd12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ffd expref: 62 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718201:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c32fcd00) 00010000:00010000:2.0:1788890999.718212:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890999.718248:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718263:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718273:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718299:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718307:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718332:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718409:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718416:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718682:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718688:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890999.718693:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718700:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718709:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:2.0:1788890999.718712:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890999.718716:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718722:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87800/0x9161b78f8ec3fd20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718734:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718739:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718751:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718756:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890999.718759:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718765:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718772:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x12fbabdd (ffff9da1c2aee400) 00010000:00010000:2.0:1788890999.718775:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890999.718777:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.718782:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec3fd27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x12fbabdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890999.719133:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:11622:x1875787987902720:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 1089us (1896us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788890999.719142:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 220 00000100:00100000:3.0:1788890999.721915:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.722473:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987902848 00000100:00100000:2.0:1788890999.722484:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987902848 00000100:00100000:2.0:1788890999.722536:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 221 00000100:00100000:2.0:1788890999.722546:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+61:11622:x1875787987902848:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788890999.722569:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890999.722596:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2004 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.722653:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.722667:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.722678:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.722776:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2004 expref: 63 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.722809:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2004 expref: 62 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.722818:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:2.0:1788890999.722821:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788890999.722825:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87600, rc 0) 00000100:00100000:2.0:1788890999.722885:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+62:11622:x1875787987902848:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 339us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.722891:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 221 00000100:00100000:1.0:1788890999.729922:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.730157:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903104 00000100:00100000:2.0:1788890999.730192:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903104 00000100:00100000:2.0:1788890999.730254:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 222 00000100:00100000:2.0:1788890999.730374:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+62:11622:x1875787987903104:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788890999.730566:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.730604:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.730616:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788890999.731289:0:11412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1788890999.731384:0:11412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000951533f6 reply state 00000000738aa2af transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890999.731395:0:11412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788890999.732666:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+64:11622:x1875787987903104:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 2395us (2747us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788890999.732678:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 222 00010000:00010000:3.0:1788890999.735504:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.735522:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.735530:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.735537:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890999.735542:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.735564:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.735581:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:3.0:1788890999.735584:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788890999.735589:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.735595:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86400/0x9161b78f8ec3fd3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890999.735702:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.735964:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903232 00000100:00100000:2.0:1788890999.735974:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903232 00000100:00100000:2.0:1788890999.736034:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 223 00000100:00100000:2.0:1788890999.736044:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+63:11622:x1875787987903232:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788890999.736078:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788890999.736096:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a200b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.736200:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a200b expref: 64 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.736217:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a200b expref: 64 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.736238:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:2.0:1788890999.736242:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788890999.736245:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87400, rc 0) 00000100:00100000:2.0:1788890999.736315:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+64:11622:x1875787987903232:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 271us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.736322:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 223 00000100:00100000:1.0:1788890999.739236:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890999.739313:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903360 00000100:00100000:3.0:1788890999.739323:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903360 00000100:00100000:3.0:1788890999.739387:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 62 00000100:00100000:3.0:1788890999.739397:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987903360:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788890999.739709:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2375:x1875787987903360:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 313us (495us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788890999.739718:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 62 00000100:00100000:3.0:1788890999.742416:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.745219:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903616 00000100:00100000:0.0:1788890999.745237:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903616 00000100:00100000:0.0:1788890999.745330:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:0.0:1788890999.745342:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fbb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+64:11622:x1875787987903616:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788890999.745653:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fbb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+65:11622:x1875787987903616:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 312us (3245us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788890999.745662:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 60 00000100:00100000:1.0:1788890999.749890:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.750018:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987903872 00000100:00100000:0.0:1788890999.750031:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987903872 00000100:00100000:0.0:1788890999.750114:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 224 00000100:00100000:0.0:1788890999.750142:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+65:11622:x1875787987903872:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788890999.750322:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+65:11622:x1875787987903872:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 182us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.750329:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 224 00000100:00100000:1.0:1788890999.758969:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890999.759078:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904000 00000100:00100000:3.0:1788890999.759092:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904000 00000100:00100000:3.0:1788890999.759164:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 225 00000100:00100000:3.0:1788890999.759213:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+65:11622:x1875787987904000:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788890999.759236:0:11412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890999.759258:0:11412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fd4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2012 expref: -99 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.759348:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3fd51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.759362:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3fd51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.759375:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3fd51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788890999.759414:0:11412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788890999.759446:0:11412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3fd51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.759474:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc400/0x9161b78f8ec3fd4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2012 expref: 67 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.759495:0:11412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3fd51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2012 expref: 66 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.759504:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:3.0:1788890999.759507:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788890999.759512:0:11412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd800, rc 0) 00000100:00100000:3.0:1788890999.759601:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+66:11622:x1875787987904000:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 391us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890999.759609:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 225 00000100:00100000:1.0:1788890999.765526:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.766154:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904128 00000100:00100000:0.0:1788890999.766165:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904128 00000100:00100000:0.0:1788890999.766281:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 63 00000100:00100000:0.0:1788890999.766292:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+10:2373:x1875787987904128:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788890999.766310:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890999.766334:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2019 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788890999.766365:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa04f78, blocks: 0x1 00010000:00010000:0.0:1788890999.766388:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=223s v=(0 0) 00010000:00010000:0.0:1788890999.766393:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788890999.766403:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2019 expref: 11 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.766432:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2019 expref: 11 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.766449:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9c00, rc 0) 00000100:00100000:0.0:1788890999.766505:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:2373:x1875787987904128:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 215us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.766512:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 63 00000100:00100000:1.0:1788890999.770663:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.770965:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904384 00000100:00100000:2.0:1788890999.770976:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904384 00000100:00100000:2.0:1788890999.771038:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 226 00000100:00100000:2.0:1788890999.771049:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+66:11622:x1875787987904384:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788890999.772554:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+66:11622:x1875787987904384:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 1499us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.772567:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 226 00000100:00100000:1.0:1788890999.776624:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890999.776878:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904512 00000100:00100000:3.0:1788890999.776897:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904512 00000100:00100000:3.0:1788890999.776961:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 64 00000100:00100000:3.0:1788890999.776987:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:11622:x1875787987904512:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788890999.777009:0:11963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788890999.777029:0:11963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2020 expref: -99 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.777076:0:11963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2019 expref: 12 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.777087:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890999.777092:0:11963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890999.777097:0:11963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 12 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.777138:0:11963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2019 expref: 12 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.777155:0:11963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2019 expref: 12 pid: 6662 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890999.777212:0:11963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffecb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11963:1875787996269184:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890999.777818:0:11963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1cab866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890999.781744:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.781798:0:11963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffecb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11963:1875787996269184:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890999.781832:0:11963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 12 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.781854:0:11963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc400, rc 0) 00000100:00100000:1.0:1788890999.782023:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904640 00000100:00100000:1.0:1788890999.782030:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904640 00010000:00010000:1.0:1788890999.782071:0:6679:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2019 expref: 13 pid: 6662 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890999.782110:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 81 00000100:00100000:1.0:1788890999.782119:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:2375:x1875787987904640:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890999.782133:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890999.782152:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2019 expref: 13 pid: 6662 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.782211:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2019 expref: 13 pid: 6662 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.782244:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ce22148/0x9161b78f8ec3fd58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2019 expref: 13 pid: 6662 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.782389:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788890999.782394:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788890999.782404:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 12 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.782415:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 12 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.782626:0:6679:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 12 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890999.782640:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f4d23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6679:1875787996269312:192.168.204.18@tcp:105: 00000100:00100000:1.0:1788890999.782700:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700240 going to sleep for 11 seconds 00000100:00100000:2.0:1788890999.782706:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+12:11622:x1875787987904512:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 5718us (6093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.782715:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 64 00000100:00100000:1.0:1788890999.785557:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f4d23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6679:1875787996269312:192.168.204.18@tcp:105: 00010000:00010000:1.0:1788890999.785589:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890999.785645:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:2375:x1875787987904640:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 3525us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890999.785655:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 81 00000100:00100000:3.0:1788890999.786616:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.786719:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904768 00000100:00100000:0.0:1788890999.786727:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904768 00002000:00100000:0.0:1788890999.786775:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9da1d0755f80 x1875787987904768/t0(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:50/0 lens 504/0 e 0 to 0 dl 1788891010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788890999.786786:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1d0755f80 with x1875787987904768 ext(0->12) 00002000:00010000:0.0:1788890999.786792:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1d0755f80 00000100:00100000:0.0:1788890999.786850:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:0.0:1788890999.786860:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+11:2375:x1875787987904768:12345-192.168.204.18@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788890999.787410:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:2375:x1875787987904768:12345-192.168.204.18@tcp:4:lhsmtool_posix.0 Request processed in 549us (794us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788890999.787428:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00002000:00100000:0.0:1788890999.787435:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9da1d0755f80 x1875787987904768/t4294967320(0) o4->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:50/0 lens 504/448 e 0 to 0 dl 1788891010 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788890999.787444:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1d0755f80 with x1875787987904768 ext(0->12) 00002000:00010000:0.0:1788890999.787448:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1d0755f80 00000100:00100000:3.0:1788890999.791214:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.791463:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987904896 00000100:00100000:2.0:1788890999.791476:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987904896 00000100:00100000:2.0:1788890999.791542:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 227 00000100:00100000:2.0:1788890999.791553:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+66:11622:x1875787987904896:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788890999.824152:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788890999.824190:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:3.0:1788890999.824252:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+65:11622:x1875787987904896:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 Request processed in 32696us (33044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890999.824282:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 227 00000020:00080000:0.0:1788890999.824677:0:5836:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9da1d13a1900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788890999.824682:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1f4e5e500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9da1d13a1840 00000020:00080000:0.0:1788890999.824685:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1f4e5e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9da1fbb30000 00000020:00080000:0.0:1788890999.824741:0:5836:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9da1c5681780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788890999.824744:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1ffb28b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9da1c5681000 00000020:00080000:0.0:1788890999.824747:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1ffb28100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9da1f50d0000 00000004:00080000:0.0:1788890999.824762:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788890999.825029:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788890999.825046:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996269440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788890999.825111:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890999.825395:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996269440 00000100:00100000:2.0:1788890999.825404:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996269440 00000020:00080000:3.0:1788890999.825501:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1788890999.825542:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788890999.825552:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875787996269440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788890999.825593:0:6662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788890999.825618:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.825640:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f7f expref: 12 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.825650:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788890999.825654:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890999.825658:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.825685:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f7f expref: 12 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788890999.825692:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1788890999.825699:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f7f expref: 12 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890999.825710:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996269568:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788890999.825762:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788890999.825825:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788890999.825835:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996269696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788890999.825866:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788890999.826003:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788890999.826133:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996269696 00000100:00100000:2.0:1788890999.826140:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996269696 00000100:00100000:2.0:1788890999.826255:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788890999.826335:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996269696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788890999.826349:0:6663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1788890999.826375:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa04f76, atime: 0x6aa04f76, ctime: 0x6aa04f76, blocks: 0xb 00010000:00010000:2.0:1788890999.826389:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.826399:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=223s v=(0 0) 00010000:00010000:2.0:1788890999.826403:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788890999.826410:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.826434:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.826445:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.826453:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.826478:0:6663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788890999.827109:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788890999.827116:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.827125:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788890999.827129:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.827138:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.827156:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.827163:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c29aff5/0x9161b78f8ec3fd6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.827197:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890999.827199:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788890999.827201:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890999.827674:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1875787996269696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1338us (1803us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788890999.827683:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788890999.827778:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788890999.827785:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:3.0:1788890999.827810:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da1ffec8000, transno 4294967307 00000004:00080000:3.0:1788890999.827862:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1788890999.827879:0:3281:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9da1cae21880 x1875787996269696/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788891015 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788890999.827900:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da1cae21880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788890999.828710:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996269696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788890999.832257:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996269568:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788890999.832289:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890999.832383:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890999.832499:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905024 00000100:00100000:3.0:1788890999.832507:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905024 00000100:00100000:1.0:1788890999.832561:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890999.832568:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 67 00000100:00100000:3.0:1788890999.832579:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:2374:x1875787987905024:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788890999.835621:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905152 00000100:00100000:0.0:1788890999.835637:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905152 00010000:00010000:0.0:1788890999.835684:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f7f expref: 14 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890999.835758:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 82 00000100:00100000:0.0:1788890999.835768:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+14:2375:x1875787987905152:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890999.835793:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890999.835799:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f7f expref: 14 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.835813:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f7f expref: 14 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.835837:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec3fb28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f7f expref: 14 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.835854:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788890999.835859:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788890999.835865:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.835875:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.835910:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890999.835968:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+13:2375:x1875787987905152:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 200us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.835976:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 82 00010000:00010000:3.0:1788890999.836039:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.836048:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.836067:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.836099:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.836223:0:6662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788890999.836640:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788890999.836647:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.836655:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788890999.836660:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.836669:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.836685:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.836692:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3f98a4d/0x9161b78f8ec3fd66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.836708:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890999.836711:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788890999.836714:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788890999.837286:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3282:x1875787996269440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11734us (12173us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788890999.837303:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1788890999.837356:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da1cafa4a80/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788890999.837370:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996269440:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788890999.855927:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1788890999.855958:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:3.0:1788890999.856265:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987905024:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 Request processed in 23675us (23870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788890999.856278:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 67 00000100:00100000:1.0:1788890999.859930:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.860005:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905408 00000100:00100000:2.0:1788890999.860018:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905408 00000100:00100000:2.0:1788890999.860098:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 228 00000100:00100000:2.0:1788890999.860109:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:11622:x1875787987905408:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788890999.860212:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890999.860247:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd800/0x9161b78f8ec3fd51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2012 expref: 20 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.860339:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:2.0:1788890999.860345:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788890999.860375:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.860387:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.860397:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788890999.860677:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000389c219e reply state 000000006935721d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890999.860694:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788890999.860811:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:11622:x1875787987905408:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 701us (889us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788890999.860819:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 228 00000100:00100000:0.0:1788890999.865219:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00010000:00010000:3.0:1788890999.865307:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.865319:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.865327:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.865334:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890999.865338:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.865345:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.865361:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:3.0:1788890999.865363:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788890999.865367:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.865373:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fd74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890999.865754:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905536 00000100:00100000:1.0:1788890999.865765:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905536 00000100:00100000:1.0:1788890999.865824:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 68 00000100:00100000:1.0:1788890999.865835:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987905536:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788890999.866128:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788890999.866132:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788890999 00002000:00010000:1.0:1788890999.866135:0:6663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788890998 00002000:00010000:1.0:1788890999.866136:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788891000 -> 1788890999 00002000:00010000:1.0:1788890999.866139:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788890999.866230:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2374:x1875787987905536:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 396us (1019us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788890999.866238:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 68 00000100:00100000:1.0:1788890999.870958:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.871113:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905792 00000100:00100000:0.0:1788890999.871123:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905792 00000100:00100000:0.0:1788890999.871278:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 229 00000100:00100000:0.0:1788890999.871289:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:11622:x1875787987905792:12345-192.168.204.18@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788890999.871371:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.871389:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2004 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.871397:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.871431:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2004 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.871445:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2004 expref: 20 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890999.871458:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffa79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875787996269824:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890999.871539:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0edd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788890999.876240:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.877873:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987905920 00000100:00100000:2.0:1788890999.877886:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987905920 00010000:00010000:2.0:1788890999.877936:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2004 expref: 21 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890999.878100:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 83 00000100:00100000:2.0:1788890999.878111:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:2375:x1875787987905920:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890999.878127:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890999.878134:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2004 expref: 21 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.878147:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2004 expref: 21 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.878232:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:2.0:1788890999.878238:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.878247:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.878255:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.878273:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788890999.878333:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:2375:x1875787987905920:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 224us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.878340:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 83 00010000:00010000:0.0:1788890999.878671:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fd35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2004 expref: 20 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890999.878691:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffa79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875787996269824:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890999.878713:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.878722:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.878728:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.878762:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.878770:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.878777:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.878783:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788890999.878787:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.878795:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.878805:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:0.0:1788890999.878809:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788890999.878813:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.878819:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890999.878859:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:11622:x1875787987905792:12345-192.168.204.18@tcp:55:lhsmtool_posix.0 Request processed in 7572us (7910us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788890999.878867:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 229 00000100:00100000:1.0:1788890999.881567:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890999.881649:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906048 00000100:00100000:3.0:1788890999.881658:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906048 00000100:00100000:3.0:1788890999.881711:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 69 00000100:00100000:3.0:1788890999.881721:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2374:x1875787987906048:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788890999.881762:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.881785:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 8 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.881793:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788890999.881798:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788890999.881802:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.881838:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 8 pid: 11963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.881851:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 8 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890999.881866:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996269952:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890999.881948:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c56813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788890999.883662:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6662:1875787996269952:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890999.883689:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890999.884331:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.884428:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906176 00000100:00100000:2.0:1788890999.884435:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906176 00010000:00010000:2.0:1788890999.884527:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 9 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890999.884669:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 84 00000100:00100000:2.0:1788890999.884680:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+9:2375:x1875787987906176:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788890999.884696:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788890999.884721:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 9 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.884736:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 9 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.884758:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec3fd5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2020 expref: 9 pid: 11963 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.884773:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890999.884777:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788890999.884783:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.884793:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.884821:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788890999.884867:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890999.884878:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987906176:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 197us (546us total) trans 0 rc 0/0 00010000:00010000:0.0:1788890999.884881:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890999.884894:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 84 00010000:00010000:0.0:1788890999.884925:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.884935:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.884943:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.884951:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edce00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788890999.884957:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.884966:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.884979:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.884996:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec3fd82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890999.885163:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987906048:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 Request processed in 3443us (3603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.885220:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 69 00000100:00100000:1.0:1788890999.889001:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788890999.889155:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906432 00000100:00100000:3.0:1788890999.889197:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906432 00000100:00100000:3.0:1788890999.889275:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 230 00000100:00100000:3.0:1788890999.889291:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:11622:x1875787987906432:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788890999.889377:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.889396:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.889431:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.889642:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.889666:0:6852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a200b expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.889675:0:6852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.889716:0:6852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a200b expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.889732:0:6852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a200b expref: 20 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890999.889747:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996270080:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788890999.889835:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c56813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788890999.893113:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.893229:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906560 00000100:00100000:0.0:1788890999.893237:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906560 00000100:00100000:2.0:1788890999.893246:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201c5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996270080:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890999.893278:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a200b expref: 21 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890999.893337:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 85 00010000:00010000:2.0:1788890999.893340:0:6852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788890999.893351:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:2374:x1875787987906560:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788890999.893383:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788890999.893391:0:6679:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a200b expref: 21 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.893403:0:6679:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a200b expref: 21 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.893423:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fd43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a200b expref: 21 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.893437:0:6679:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:1.0:1788890999.893442:0:6679:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.893451:0:6679:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.893458:0:6679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.893493:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788890999.893548:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:2374:x1875787987906560:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 201us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890999.893555:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 85 00010000:00010000:2.0:1788890999.893742:0:6852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.893751:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788890999.894084:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788890999.894230:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788890999.894267:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788890999.894331:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6852:1875787996270208:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788890999.894370:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788890999.894435:0:11998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996270208 00000100:00100000:1.0:1788890999.894440:0:11998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996270208 00000100:00100000:2.0:1788890999.894443:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890999.895250:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788890999.895265:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6852:x1875787996270208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788890999.895353:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6852:x1875787996270208:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.895360:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788890999.895652:0:6852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1788890999.895670:0:6852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1788890999.895693:0:6852:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9da1cafa4a80 x1875787996269440/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788891015 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788890999.895703:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6852:1875787996270208:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788890999.896585:0:6852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788890999.896659:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6852:1875787996270336:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788890999.896702:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788890999.896830:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0faf480 going to sleep for 11 seconds 00000100:00100000:0.0:1788890999.896898:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996270336 00000100:00100000:0.0:1788890999.896905:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996270336 00000100:00100000:0.0:1788890999.896983:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788890999.896992:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6852:x1875787996270336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788890999.897206:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6852:x1875787996270336:12345-0@lo:1000:mdt00_003.0 Request processed in 214us (501us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788890999.897226:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788890999.897303:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6852:1875787996270336:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788890999.897336:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897347:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897354:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897360:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890999.897365:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897372:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897390:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c2aee000) 00010000:00010000:3.0:1788890999.897393:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788890999.897397:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897404:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc000/0x9161b78f8ec3fd90 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897433:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897448:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897454:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897459:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788890999.897462:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897468:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897478:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:3.0:1788890999.897480:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788890999.897487:0:6852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fef expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897499:0:6852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fef expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897507:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fef expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788890999.897535:0:6852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fef expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890999.897547:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996270464:192.168.204.18@tcp:105: 00000100:00100000:3.0:1788890999.897625:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8518cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788890999.900750:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c3288e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6852:1875787996270464:192.168.204.18@tcp:105: 00010000:00010000:2.0:1788890999.900779:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900805:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fcd3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900834:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900846:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900856:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900866:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900872:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900878:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900884:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890999.900888:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900895:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900906:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788890999.900909:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788890999.900912:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900928:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fd97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900939:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900944:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900950:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900955:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788890999.900958:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900964:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900972:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788890999.900974:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788890999.900978:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.900983:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd000/0x9161b78f8ec3fd89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788890999.901264:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:11622:x1875787987906432:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 11978us (12273us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788890999.901275:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 230 00000020:00080000:2.0:1788890999.901353:0:6852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788890999.901515:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788890999.901519:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788890999.902023:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:1.0:1788890999.902038:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788890999.902545:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788890999.902622:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.902812:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906688 00000100:00100000:0.0:1788890999.902821:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906688 00000100:00100000:0.0:1788890999.902854:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987906944 00000100:00100000:0.0:1788890999.902857:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987906944 00000100:00100000:0.0:1788890999.902871:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:0.0:1788890999.902880:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:11621:x1875787987906688:12345-192.168.204.18@tcp:49:lfs.0 00000100:00100000:0.0:1788890999.902993:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+24:11621:x1875787987906688:12345-192.168.204.18@tcp:49:lfs.0 Request processed in 112us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.903011:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 61 00000100:00100000:0.0:1788890999.903026:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 62 00000100:00100000:0.0:1788890999.903033:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d03be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:11622:x1875787987906944:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788890999.903625:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788890999.903730:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788890999.903771:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.903785:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.903795:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.903803:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.903809:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.903815:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.903839:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788890999.903909:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d03be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11622:x1875787987906944:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 876us (1285us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788890999.903917:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 62 00000020:00080000:0.0:1788890999.903919:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788890999.904020:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788890999.904027:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.904034:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788890999.904038:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.904046:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.904068:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9da1c870c400) 00010000:00010000:2.0:1788890999.904071:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788890999.904076:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.904081:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fd9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788890999.904093:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890999.904095:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788890999.904096:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788890999.905896:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.905974:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907200 00000100:00100000:2.0:1788890999.905981:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907200 00000100:00100000:2.0:1788890999.906033:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 231 00000100:00100000:2.0:1788890999.906042:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11621:x1875787987907200:12345-192.168.204.18@tcp:58:lfs.0 00000040:00080000:2.0:1788890999.906464:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788890999.906541:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11621:x1875787987907200:12345-192.168.204.18@tcp:58:lfs.0 Request processed in 499us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788890999.906549:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 231 00010000:00010000:0.0:1788890999.927392:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788890999.927631:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.931668:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907328 00000100:00100000:0.0:1788890999.931688:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907328 00000100:00100000:0.0:1788890999.931765:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 232 00000100:00100000:0.0:1788890999.931777:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+25:11624:x1875787987907328:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:0.0:1788890999.931798:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788890999.931822:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fda5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2027 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.931896:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.931912:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.931925:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.931941:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.931948:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.931955:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.932239:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.932251:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe8 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.932272:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.932308:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe8 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.932322:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe8 expref: 26 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890999.932337:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffa79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875787996270592:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788890999.932545:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0edd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788890999.944465:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788890999.944560:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907584 00000100:00100000:2.0:1788890999.944569:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907584 00000100:00100000:2.0:1788890999.944631:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 63 00000100:00100000:2.0:1788890999.944642:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c3288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:5600:x1875787987907584:12345-192.168.204.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788890999.944897:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c3288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:5600:x1875787987907584:12345-192.168.204.18@tcp:35:ldlm_bl.0 Request processed in 256us (442us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788890999.944905:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 63 00000100:00100000:0.0:1788890999.945126:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffa79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875787996270592:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788890999.945153:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788890999.948848:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788890999.948961:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907712 00000100:00100000:0.0:1788890999.948972:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907712 00010000:00010000:0.0:1788890999.949017:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe8 expref: 28 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788890999.949073:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 86 00000100:00100000:0.0:1788890999.949084:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:2374:x1875787987907712:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788890999.949100:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788890999.949107:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe8 expref: 28 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.949142:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe8 expref: 28 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.949209:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fcc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fe8 expref: 28 pid: 5816 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.949229:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:0.0:1788890999.949236:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.949246:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.949255:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788890999.949284:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788890999.949344:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:2374:x1875787987907712:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 261us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788890999.949352:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 86 00010000:00010000:1.0:1788890999.950607:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950621:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788890999.950664:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788890999.950668:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788890999.950687:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950701:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950721:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950727:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950734:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950740:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890999.950845:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950854:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950884:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:1.0:1788890999.950887:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890999.950892:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950899:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8200/0x9161b78f8ec3fdac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950913:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950920:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950926:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950931:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:1.0:1788890999.950935:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950941:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950947:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9da1c870c000) 00010000:00010000:1.0:1788890999.950949:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788890999.950953:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.950959:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9c00/0x9161b78f8ec3fdb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.951017:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8600/0x9161b78f8ec3fda5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2027 expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.951031:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2027 expref: 26 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788890999.951038:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:1.0:1788890999.951041:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788890999.951043:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8000, rc 0) 00000100:00100000:1.0:1788890999.951110:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11624:x1875787987907328:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 19335us (23485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788890999.951118:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 232 00000100:00100000:3.0:1788891000.376562:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788891000.376590:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996270848:0@lo:400:kworker.0 00000100:00100000:2.0:1788891000.376621:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996270976:0@lo:400:kworker.0 00000100:00100000:2.0:1788891000.376669:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996271104:0@lo:400:kworker.0 00000100:00100000:3.0:1788891000.376671:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891000.376720:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891000.376745:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996270720:0@lo:400:kworker.0 00000100:00100000:2.0:1788891000.376786:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996270848 00000100:00100000:3.0:1788891000.376788:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891000.376803:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996270848 00000100:00100000:1.0:1788891000.376810:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996271232:0@lo:400:kworker.0 00000100:00100000:1.0:1788891000.376847:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891000.376854:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788891000.376864:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996270848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891000.376881:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788891000.376890:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996271360:0@lo:400:kworker.0 00000100:00100000:2.0:1788891000.376927:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996270848:12345-0@lo:400:kworker.0 Request processed in 63us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891000.376928:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891000.376938:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788891000.376943:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996270848:0@lo:400:kworker.0 00000100:00100000:2.0:1788891000.376959:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996271232 00000100:00100000:2.0:1788891000.376964:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996271232 00000100:00100000:3.0:1788891000.376986:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996270720 00000100:00100000:3.0:1788891000.376991:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996270720 00000100:00100000:2.0:1788891000.377003:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788891000.377028:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788891000.377038:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996270720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891000.377095:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996270720:12345-0@lo:400:kworker.0 Request processed in 58us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891000.377102:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:1.0:1788891000.377124:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891000.377137:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996271104 00000100:00100000:1.0:1788891000.377141:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996271104 00000100:00100000:1.0:1788891000.377187:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996271360 00000100:00100000:1.0:1788891000.377190:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996271360 00000100:00100000:1.0:1788891000.377215:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788891000.377222:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1875787996271104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891000.377276:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1875787996271104:12345-0@lo:400:kworker.0 Request processed in 54us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891000.377292:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788891000.377305:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788891000.377311:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1875787996271360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891000.377348:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1875787996271360:12345-0@lo:400:kworker.0 Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891000.377355:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788891000.377361:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996270720:0@lo:400:kworker.0 00000100:00100000:2.0:1788891000.378129:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996271232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891000.378186:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996271232:12345-0@lo:400:kworker.0 Request processed in 63us (1340us total) trans 0 rc 0/0 00000100:00080000:1.0:1788891000.380548:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788891000.380602:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996271360:0@lo:400:kworker.0 00000100:00100000:1.0:1788891000.380618:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996271232:0@lo:400:kworker.0 00000100:00100000:1.0:1788891000.380738:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996271104:0@lo:400:kworker.0 00000100:00100000:1.0:1788891000.380774:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891000.380818:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996270976 00000100:00100000:1.0:1788891000.380825:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996270976 00000100:00100000:1.0:1788891000.381083:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788891000.381094:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996270976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891000.381193:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996270976:12345-0@lo:400:kworker.0 Request processed in 78us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891000.381201:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1788891000.381221:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891000.381244:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996270976:0@lo:400:kworker.0 00000100:00100000:2.0:1788891000.381368:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000040:00080000:3.0:1788891000.475949:0:12490:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788891000.475959:0:12490:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788891000.476017:0:12490:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 7 00000040:00080000:3.0:1788891000.476024:0:12490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788891000.886586:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996271488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891000.886667:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891000.886729:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996271488 00000100:00100000:2.0:1788891000.886751:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996271488 00000100:00100000:2.0:1788891000.886815:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788891000.886825:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875787996271488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788891000.886861:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788891000.886918:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875787996271488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891000.886925:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788891000.887854:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996271488:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788891000.951788:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891000.951798:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1788891000.951998:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788891000.952348:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788891000.952527:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788891000.952655:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffec8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996271616:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788891000.952770:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0fafc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788891000.962005:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891000.962104:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987907840 00000100:00100000:1.0:1788891000.962127:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987907840 00000100:00100000:1.0:1788891000.962245:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 233 00000100:00100000:1.0:1788891000.962255:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:11636:x1875787987907840:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000100:00080000:0.0:1788891000.962264:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1788891000.962296:0:11412:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788891000.962413:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:11636:x1875787987907840:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 159us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891000.962421:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 233 00000100:00100000:2.0:1788891000.962930:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffec8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11659:1875787996271616:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788891000.967751:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891000.967863:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908096 00000100:00100000:1.0:1788891000.967877:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908096 00000100:00100000:1.0:1788891000.967945:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 234 00000100:00100000:1.0:1788891000.967957:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+26:11636:x1875787987908096:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891000.967974:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891000.967993:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fdc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a202e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891000.968313:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fdc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891000.968329:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891000.968341:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788891000.968352:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788891000.969784:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fe00/0x9161b78f8ec3fdc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a202e expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891000.969814:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fdc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a202e expref: 28 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891000.969843:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:1.0:1788891000.969847:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788891000.969850:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e600, rc 0) 00000100:00100000:1.0:1788891000.969932:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:11636:x1875787987908096:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 1976us (2189us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788891000.969942:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 234 00000100:00100000:0.0:1788891000.973734:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891000.973817:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891000.973928:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908480 00000100:00100000:1.0:1788891000.973937:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908480 00000100:00100000:1.0:1788891000.974003:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:1.0:1788891000.974013:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:2372:x1875787987908480:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891000.974026:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891000.974060:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e600/0x9161b78f8ec3fdc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a202e expref: 28 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891000.974078:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:1.0:1788891000.974081:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891000.974161:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:2372:x1875787987908480:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 149us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891000.974199:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:2.0:1788891000.975521:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908352 00000100:00100000:2.0:1788891000.975532:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908352 00000100:00100000:2.0:1788891000.975625:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 235 00000100:00100000:2.0:1788891000.975634:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+27:11636:x1875787987908352:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788891000.975711:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891000.975729:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891000.975740:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891000.976045:0:6852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891000.976066:0:6852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891000.976072:0:6852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891000.976077:0:6852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891000.976081:0:6852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891000.976088:0:6852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891000.976100:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788891000.976103:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788891000.976107:0:6852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891000.976113:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fdd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891000.976456:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:11636:x1875787987908352:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 821us (2729us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788891000.976465:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 235 00000040:00080000:3.0:1788891000.979806:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788891000.979815:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788891000.980966:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788891000.980982:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788891000.981509:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891000.981584:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908736 00000100:00100000:2.0:1788891000.981593:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908736 00000100:00100000:2.0:1788891000.981696:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 64 00000100:00100000:2.0:1788891000.981707:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+28:11636:x1875787987908736:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788891000.981970:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:11636:x1875787987908736:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 265us (466us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788891000.982001:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 64 00010000:00010000:2.0:1788891001.974327:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891002.030122:0:12542:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788891002.030131:0:12542:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891002.030302:0:12542:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788891002.030310:0:12542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788891002.090491:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891002.090526:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891002.090551:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908864 00000100:00100000:0.0:1788891002.090558:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891002.090562:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908864 00000100:00100000:0.0:1788891002.090584:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891002.090617:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891002.090623:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 274 00000100:00100000:2.0:1788891002.090636:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987908864:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788891002.090652:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909376 00000100:00100000:0.0:1788891002.090658:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909376 00000100:00100000:2.0:1788891002.090708:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47df6031-18d1-4179-91e9-917028d5aced+13:2373:x1875787987908864:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891002.090714:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987908992 00000100:00100000:2.0:1788891002.090719:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 274 00000100:00100000:0.0:1788891002.090721:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987908992 00000100:00100000:0.0:1788891002.090751:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 112 00000100:00100000:0.0:1788891002.090760:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2373:x1875787987909376:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788891002.090792:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:2373:x1875787987909376:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 34us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891002.090799:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 112 00000100:00100000:0.0:1788891002.090813:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 113 00000100:00100000:0.0:1788891002.090819:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:2373:x1875787987908992:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788891002.090847:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:2373:x1875787987908992:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891002.090853:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 113 00000100:00080000:0.0:1788891002.090868:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891002.090929:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909120 00000100:00100000:1.0:1788891002.090939:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909120 00000100:00100000:1.0:1788891002.091021:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909248 00000100:00100000:1.0:1788891002.091025:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909248 00000100:00100000:2.0:1788891002.091101:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 71 00000100:00100000:2.0:1788891002.091110:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987909120:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891002.091140:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2373:x1875787987909120:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891002.091147:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 71 00000100:00080000:0.0:1788891002.092227:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788891002.092233:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891002.092343:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 72 00000100:00100000:1.0:1788891002.092351:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987909248:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788891002.092391:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2373:x1875787987909248:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 41us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891002.092397:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 72 00000100:00100000:0.0:1788891002.142077:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891002.142344:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909632 00000100:00100000:2.0:1788891002.142359:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909632 00000100:00100000:2.0:1788891002.142435:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 236 00000100:00100000:2.0:1788891002.142449:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+29:11657:x1875787987909632:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788891002.142477:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891002.142503:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fddd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2035 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.142629:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fde4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.142666:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fde4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.142681:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fde4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891002.142696:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788891002.142869:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec3fddd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2035 expref: 32 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.142888:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fde4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2035 expref: 31 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.142911:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788891002.142914:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788891002.142918:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87600, rc 0) 00000100:00100000:2.0:1788891002.142993:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:11657:x1875787987909632:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 548us (931us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788891002.143001:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 236 00000100:00100000:1.0:1788891002.145781:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891002.145841:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909760 00000100:00100000:2.0:1788891002.145856:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909760 00000100:00100000:2.0:1788891002.145933:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 237 00000100:00100000:2.0:1788891002.145948:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:11657:x1875787987909760:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:2.0:1788891002.146045:0:11412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.146064:0:11412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.146113:0:11412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.146146:0:11412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.146154:0:11412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.146162:0:11412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.146194:0:11412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891002.146199:0:11412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.146208:0:11412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.146222:0:11412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:2.0:1788891002.146225:0:11412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891002.146231:0:11412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.146237:0:11412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec3fdf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891002.146437:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+31:11657:x1875787987909760:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 493us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891002.146446:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 237 00000100:00100000:1.0:1788891002.213547:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891002.213660:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987909888 00000100:00100000:2.0:1788891002.213669:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987909888 00000100:00100000:2.0:1788891002.213851:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 70 00000100:00100000:2.0:1788891002.213862:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987909888:12345-192.168.204.18@tcp:101:cat.0 00010000:00010000:2.0:1788891002.213882:0:6664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891002.213905:0:6664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba54fe92/0x9161b78f8ec3fdf9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a203c expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891002.213932:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa04f77, atime: 0x6aa04f76, ctime: 0x6aa04f77, blocks: 0xb 00010000:00010000:2.0:1788891002.213951:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=226s v=(0 0) 00010000:00010000:2.0:1788891002.213956:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891002.213965:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba54fe92/0x9161b78f8ec3fdf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a203c expref: 8 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.213984:0:6664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba54fe92/0x9161b78f8ec3fdf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a203c expref: 8 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891002.213998:0:6664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86e00, rc 0) 00000100:00100000:2.0:1788891002.214070:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2374:x1875787987909888:12345-192.168.204.18@tcp:101:cat.0 Request processed in 209us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891002.214077:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 70 00000100:00100000:0.0:1788891002.217476:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891002.217577:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910016 00000100:00100000:3.0:1788891002.217586:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910016 00002000:00100000:3.0:1788891002.217635:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9da1ffa78700 x1875787987910016/t0(0) o3->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:53/0 lens 488/0 e 0 to 0 dl 1788891013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788891002.217647:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1ffa78700 with x1875787987910016 ext(0->4095) 00002000:00010000:3.0:1788891002.217653:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1ffa78700 00000100:00100000:3.0:1788891002.217687:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:3.0:1788891002.217697:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987910016:12345-192.168.204.18@tcp:3:cat.0 00000100:00100000:3.0:1788891002.218108:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+8:2375:x1875787987910016:12345-192.168.204.18@tcp:3:cat.0 Request processed in 411us (639us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788891002.218117:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 7 00002000:00100000:3.0:1788891002.218124:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9da1ffa78700 x1875787987910016/t0(0) o3->671ae218-3c0c-4db9-9d11-9d6b732a0de5@192.168.204.18@tcp:53/0 lens 488/4536 e 0 to 0 dl 1788891013 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788891002.218133:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9da1ffa78700 with x1875787987910016 ext(0->4095) 00002000:00010000:3.0:1788891002.218137:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9da1ffa78700 00010000:00010000:3.0:1788891003.000865:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788891003.958532:0:6851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 227807361609ns, next at 228807358961ns, rc = 0 00000100:00100000:2.0:1788891003.958544:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996271744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891003.958618:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891003.958700:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996271744 00000100:00100000:2.0:1788891003.958708:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996271744 00000100:00100000:2.0:1788891003.958777:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788891003.958788:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875787996271744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788891003.958835:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788891003.958905:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875787996271744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891003.958913:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788891003.958965:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891003.959286:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996271744:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788891004.005123:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1788891004.022442:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788891005.027196:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:0.0:1788891005.027220:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:0.0:1788891005.027232:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:0.0:1788891005.027239:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788891005.027265:0:5836:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9da1c56813c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788891005.027279:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1f4d24700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9da1c5681000 00000020:00080000:0.0:1788891005.027282:0:5836:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9da1f4d24d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9da1f4e6cc00 00000020:00080000:0.0:1788891005.027305:0:5836:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788891005.027385:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788891005.027578:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1788891005.027590:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891005.027609:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1ffa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996271872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788891005.027683:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1788891005.028148:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1788891005.028159:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:1.0:1788891005.028733:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996271872 00000100:00100000:1.0:1788891005.028743:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996271872 00000100:00080000:0.0:1788891005.028801:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891005.028827:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788891005.028839:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffa78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996271872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788891005.031126:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788891005.031136:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788890999 -> 1788890999 00002000:00010000:1.0:1788891005.031139:0:6663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788890998 -> 1788890998 00002000:00010000:1.0:1788891005.031142:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788890999 -> 1788890999 00002000:00010000:1.0:1788891005.031144:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788891005.031243:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffa78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996271872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2404us (3556us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788891005.031254:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788891005.031330:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1788891005.031336:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da1cafa4a80, transno 4294967321 00000004:00080000:1.0:1788891005.031347:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1788891005.031369:0:3280:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9da1ffa78e00 x1875787996271872/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788891021 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788891005.031395:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da1ffa78e00/2, rc 0, transno 4294967324 00000100:00100000:1.0:1788891005.031402:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1ffa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996271872:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788891005.050053:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891005.094029:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891005.094138:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910144 00000100:00100000:1.0:1788891005.094149:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910144 00000100:00100000:1.0:1788891005.094278:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 238 00000100:00100000:1.0:1788891005.094289:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:11310:x1875787987910144:12345-192.168.204.18@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788891005.094410:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:11310:x1875787987910144:12345-192.168.204.18@tcp:60:lhsmtool_posix.0 Request processed in 124us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891005.094418:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 238 00000100:00080000:0.0:1788891005.094457:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891005.099755:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891005.099969:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910400 00000100:00100000:3.0:1788891005.099982:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910400 00000100:00100000:3.0:1788891005.100047:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 65 00000100:00100000:3.0:1788891005.100059:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+18:11310:x1875787987910400:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788891005.100658:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:11310:x1875787987910400:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 599us (911us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788891005.100680:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 65 00000100:00100000:0.0:1788891005.258818:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891005.258911:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910528 00000100:00100000:2.0:1788891005.258923:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910528 00000100:00100000:2.0:1788891005.259019:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 239 00000100:00100000:2.0:1788891005.259032:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+5:12107:x1875787987910528:12345-192.168.204.18@tcp:101:lsof.0 00010000:00010000:2.0:1788891005.259055:0:6852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891005.259076:0:6852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fe00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2043 expref: -99 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891005.259143:0:6852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fe07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891005.259158:0:6852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fe07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891005.259213:0:6852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fe07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891005.259251:0:6852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788891005.259255:0:6852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788891005.259280:0:6852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fe07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891005.259305:0:6852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86c00/0x9161b78f8ec3fe00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2043 expref: 7 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891005.259346:0:6852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fe07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2043 expref: 6 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891005.259355:0:6852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:2.0:1788891005.259358:0:6852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891005.259362:0:6852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87200, rc 0) 00000100:00080000:0.0:1788891005.259500:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788891005.259691:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:12107:x1875787987910528:12345-192.168.204.18@tcp:101:lsof.0 Request processed in 661us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891005.259699:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 239 00000100:00100000:1.0:1788891005.494517:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996272256:0@lo:400:kworker.0 00000100:00100000:1.0:1788891005.494609:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891005.494678:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788891005.494684:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996272128:0@lo:400:kworker.0 00000100:00100000:1.0:1788891005.494707:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891005.494724:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996272640:0@lo:400:kworker.0 00000100:00100000:1.0:1788891005.494772:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891005.494775:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996272256 00000100:00100000:1.0:1788891005.494810:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996272128 00000100:00100000:1.0:1788891005.494818:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996272128 00000100:00100000:2.0:1788891005.494857:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996272384:0@lo:400:kworker.0 00000100:00100000:3.0:1788891005.494865:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996272256 00000100:00100000:1.0:1788891005.494869:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788891005.494883:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996272128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891005.494898:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891005.494926:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788891005.494937:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996272256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891005.494937:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788891005.494958:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996272128:12345-0@lo:400:kworker.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891005.494961:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996272000:0@lo:400:kworker.0 00000100:00100000:1.0:1788891005.494972:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788891005.495006:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996272640 00000100:00100000:1.0:1788891005.495010:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996272640 00000100:00100000:2.0:1788891005.495016:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891005.495021:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996272256:12345-0@lo:400:kworker.0 Request processed in 86us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891005.495030:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788891005.495051:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996272384 00000100:00100000:1.0:1788891005.495056:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996272384 00000100:00100000:2.0:1788891005.495059:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996272512:0@lo:400:kworker.0 00000100:00100000:3.0:1788891005.495063:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996272000 00000100:00100000:3.0:1788891005.495069:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996272000 00000100:00100000:1.0:1788891005.495090:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788891005.495100:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996272128:0@lo:400:kworker.0 00000100:00100000:1.0:1788891005.495101:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996272640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891005.495112:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891005.495121:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788891005.495127:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996272256:0@lo:400:kworker.0 00000100:00100000:3.0:1788891005.495134:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3279:x1875787996272000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891005.495192:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996272640:12345-0@lo:400:kworker.0 Request processed in 69us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891005.495210:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788891005.495213:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3279:x1875787996272000:12345-0@lo:400:kworker.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891005.495226:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788891005.495231:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788891005.495234:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1875787996272384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891005.495269:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1875787996272384:12345-0@lo:400:kworker.0 Request processed in 36us (372us total) trans 0 rc 0/0 00000100:00080000:3.0:1788891005.495270:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788891005.495278:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891005.495279:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788891005.495304:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788891005.495309:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da1cae21880, transno 4294967310 00000100:00100000:0.0:1788891005.495324:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996272640:0@lo:400:kworker.0 00000100:00100000:3.0:1788891005.495692:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996272512 00000100:00100000:3.0:1788891005.495697:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996272512 00000100:00100000:2.0:1788891005.495723:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996272384:0@lo:400:kworker.0 00000100:00100000:2.0:1788891005.495743:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996272000:0@lo:400:kworker.0 00000100:00100000:3.0:1788891005.495754:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788891005.495762:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996272512:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788891005.495841:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891005.495907:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996272512:12345-0@lo:400:kworker.0 Request processed in 145us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891005.495913:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788891005.495992:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996272512:0@lo:400:kworker.0 00000100:00100000:1.0:1788891006.008490:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891006.008517:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996272768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891006.008590:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891006.008653:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996272768 00000100:00100000:2.0:1788891006.008663:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996272768 00000100:00100000:2.0:1788891006.008717:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788891006.008728:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996272768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788891006.008781:0:6666:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788891006.008839:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996272768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891006.008847:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788891006.008965:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996272768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788891006.070392:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891007.094610:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891007.212157:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891007.212294:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910656 00000100:00100000:2.0:1788891007.212306:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910656 00000100:00100000:2.0:1788891007.212361:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 276 00000100:00100000:2.0:1788891007.212371:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987910656:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891007.212487:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47df6031-18d1-4179-91e9-917028d5aced+13:2374:x1875787987910656:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 117us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891007.212495:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 276 00000100:00100000:3.0:1788891007.216881:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891007.216934:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891007.216996:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911040 00000100:00100000:1.0:1788891007.217004:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911040 00000100:00100000:1.0:1788891007.217070:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:1.0:1788891007.217080:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2375:x1875787987911040:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788891007.217150:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2375:x1875787987911040:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 71us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891007.217159:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:2.0:1788891007.218357:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910784 00000100:00100000:2.0:1788891007.218364:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910784 00000100:00100000:2.0:1788891007.218407:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 117 00000100:00100000:2.0:1788891007.218415:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:2375:x1875787987910784:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891007.218468:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:2375:x1875787987910784:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 54us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891007.218475:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 117 00000100:00080000:3.0:1788891007.218583:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788891007.218589:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788891007.218972:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891007.219249:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987910912 00000100:00100000:2.0:1788891007.219254:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987910912 00000100:00080000:3.0:1788891007.219291:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891007.219303:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 76 00000100:00100000:2.0:1788891007.219312:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987910912:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891007.219362:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2374:x1875787987910912:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 51us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891007.219368:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 76 00000100:00100000:2.0:1788891007.219965:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891007.220034:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911168 00000100:00100000:3.0:1788891007.220038:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911168 00000100:00080000:0.0:1788891007.220073:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891007.220085:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 118 00000100:00100000:3.0:1788891007.220093:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:2374:x1875787987911168:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788891007.220136:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:2374:x1875787987911168:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891007.220142:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 118 00000001:02000400:2.0:1788891007.420149:0:12742:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:10:06 (1788891006) 00010000:00010000:1.0:1788891008.119541:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891009.078685:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891009.078708:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996272896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891009.078775:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891009.078898:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996272896 00000100:00100000:3.0:1788891009.078906:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996272896 00000100:00100000:3.0:1788891009.078974:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788891009.078984:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996272896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788891009.079017:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788891009.079057:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996272896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891009.079064:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788891009.079162:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788891009.079210:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996272896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788891009.148040:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891009.912658:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891009.912788:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911424 00000100:00100000:3.0:1788891009.912799:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911424 00000100:00100000:3.0:1788891009.912881:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 66 00000100:00100000:3.0:1788891009.912894:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+19:12328:x1875787987911424:12345-192.168.204.18@tcp:35:umount.0 00000100:00080000:0.0:1788891009.912910:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891009.913213:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:12328:x1875787987911424:12345-192.168.204.18@tcp:35:umount.0 Request processed in 322us (566us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788891009.913233:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 66 00000100:00100000:3.0:1788891009.914885:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891009.914945:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911680 00000100:00100000:2.0:1788891009.914954:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911680 00000100:00100000:2.0:1788891009.915003:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 67 00000100:00100000:2.0:1788891009.915024:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+20:12328:x1875787987911680:12345-192.168.204.18@tcp:35:umount.0 00000100:00100000:2.0:1788891009.915377:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:12328:x1875787987911680:12345-192.168.204.18@tcp:35:umount.0 Request processed in 364us (494us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788891009.915384:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 67 00000100:00100000:2.0:1788891009.917084:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891009.917163:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987911936 00000100:00100000:3.0:1788891009.917194:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987911936 00000100:00100000:3.0:1788891009.917250:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 68 00000100:00100000:3.0:1788891009.917259:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d03be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+21:12328:x1875787987911936:12345-192.168.204.18@tcp:35:umount.0 00000100:00100000:3.0:1788891009.917459:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d03be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:12328:x1875787987911936:12345-192.168.204.18@tcp:35:umount.0 Request processed in 201us (382us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788891009.917467:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 68 00000100:00100000:3.0:1788891009.918994:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891009.919198:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912192 00000100:00100000:0.0:1788891009.919206:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912192 00000100:00100000:0.0:1788891009.919289:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 69 00000100:00100000:0.0:1788891009.919300:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:12328:x1875787987912192:12345-192.168.204.18@tcp:35:umount.0 00000100:00100000:0.0:1788891009.919591:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:12328:x1875787987912192:12345-192.168.204.18@tcp:35:umount.0 Request processed in 293us (602us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788891009.919599:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 69 00000100:00100000:1.0:1788891009.921918:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891009.921963:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891009.921991:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912320 00000100:00100000:2.0:1788891009.922000:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912320 00000100:00100000:2.0:1788891009.922052:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912448 00000100:00100000:2.0:1788891009.922055:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912448 00000100:00100000:2.0:1788891009.922114:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:2.0:1788891009.922124:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47df6031-18d1-4179-91e9-917028d5aced+14:2375:x1875787987912320:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891009.922138:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891009.922159:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1f4edc600/0x9161b78f8ec3ee7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bce expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891009.922229:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 20 00000100:00100000:3.0:1788891009.922239:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47df6031-18d1-4179-91e9-917028d5aced+14:2375:x1875787987912448:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891009.922247:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891009.922257:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29ee800/0x9161b78f8ec3ede5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1b96 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.922278:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891009.922302:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891009.922330:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47df6031-18d1-4179-91e9-917028d5aced+12:2375:x1875787987912320:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 208us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.922337:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:3.0:1788891009.922432:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47df6031-18d1-4179-91e9-917028d5aced+11:2375:x1875787987912448:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 88us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891009.922440:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 20 00000100:00100000:2.0:1788891009.922528:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891009.922642:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912576 00000100:00100000:0.0:1788891009.922647:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912576 00000100:00100000:0.0:1788891009.922751:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:0.0:1788891009.922759:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+11:2373:x1875787987912576:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891009.922768:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891009.922782:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0030800/0x9161b78f8ec3f062 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c99 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.922793:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891009.922867:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+10:2373:x1875787987912576:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891009.922877:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:1.0:1788891009.924775:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891009.924990:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987912704 00000100:00100000:2.0:1788891009.925012:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987912704 00000100:00080000:0.0:1788891009.925119:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891009.925522:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 72 00000100:00100000:2.0:1788891009.925536:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2371:x1875787987912704:12345-192.168.204.18@tcp:9:umount.0 00000020:00000080:2.0:1788891009.925564:0:11963:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3f157 00000100:00080000:2.0:1788891009.925573:0:11963:0:(import.c:65:import_set_state_nolock()) ffff9da0c1182000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891009.925617:0:11963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788891009.925931:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+2:2371:x1875787987912704:12345-192.168.204.18@tcp:9:umount.0 Request processed in 399us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.925940:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 72 00010000:00010000:3.0:1788891009.925988:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891009.930373:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891009.930577:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987913088 00000100:00100000:2.0:1788891009.930588:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987913088 00000100:00100000:2.0:1788891009.930674:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 73 00000100:00100000:2.0:1788891009.930686:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+7:2371:x1875787987913088:12345-192.168.204.18@tcp:9:umount.0 00000020:00000080:2.0:1788891009.930720:0:6663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3f3b8 00000020:00010000:2.0:1788891009.930727:0:6663:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9da1ca804800: total 0 00000100:00080000:2.0:1788891009.930732:0:6663:0:(import.c:65:import_set_state_nolock()) ffff9da1d1b20800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788891009.930830:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1788891009.930893:0:6663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788891009.931157:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:671ae218-3c0c-4db9-9d11-9d6b732a0de5+5:2371:x1875787987913088:12345-192.168.204.18@tcp:9:umount.0 Request processed in 472us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891009.931194:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 73 00000020:00010000:3.0:1788891009.933585:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9da1ca804800: total 0 00010000:00010000:3.0:1788891009.933638:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9da1ca804800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788891009.933700:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba54fe92/0x9161b78f8ec3fdf9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a203c expref: 4 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.933758:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec3f75b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e6e expref: 3 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891009.933772:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9da1ca804800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788891009.933783:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891009.933785:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891009.933787:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891009.938925:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891009.938998:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914112 00000100:00100000:3.0:1788891009.939008:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914112 00000100:00100000:3.0:1788891009.939078:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 240 00000100:00100000:3.0:1788891009.939088:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+23:2371:x1875787987914112:12345-192.168.204.18@tcp:39:umount.0 00000020:00000080:3.0:1788891009.939125:0:6852:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3edf3 00000020:00010000:3.0:1788891009.939140:0:6852:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9da1f4c1d000: total 0 00000100:00080000:3.0:1788891009.939145:0:6852:0:(import.c:65:import_set_state_nolock()) ffff9da1f4c19000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788891009.939209:0:6852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788891009.939575:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:671ae218-3c0c-4db9-9d11-9d6b732a0de5+22:2371:x1875787987914112:12345-192.168.204.18@tcp:39:umount.0 Request processed in 487us (658us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788891009.939583:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 240 00000020:00010000:0.0:1788891009.939728:0:5802:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9da1f4c1d000: total 0 00010000:00010000:0.0:1788891009.939770:0:5802:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9da1f4c1d000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788891009.939803:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:0.0:1788891009.939806:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891009.939824:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb8000/0x9161b78f8ec3fdba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2027 expref: 21 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939843:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:0.0:1788891009.939846:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891009.939850:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da201cb9400/0x9161b78f8ec3f7bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e8a expref: 20 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939871:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:0.0:1788891009.939873:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891009.939877:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87000/0x9161b78f8ec3f0d9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cae expref: 19 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939893:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:0.0:1788891009.939895:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891009.939899:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e200/0x9161b78f8ec3f71c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e59 expref: 18 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939910:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:0.0:1788891009.939912:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788891009.939915:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86000/0x9161b78f8ec3f746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e67 expref: 17 pid: 11412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939926:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:0.0:1788891009.939928:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788891009.939931:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87600/0x9161b78f8ec3fde4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2035 expref: 16 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939941:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9da1c32fc000) 00010000:00010000:0.0:1788891009.939948:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891009.939953:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6fa00/0x9161b78f8ec3f0bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1ca7 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939968:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788891009.939971:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788891009.939975:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87c00/0x9161b78f8ec3f7d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e91 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.939986:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9da1c2aee600) 00010000:00010000:0.0:1788891009.939988:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788891009.939991:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edde00/0x9161b78f8ec3fab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1f63 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.940006:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:0.0:1788891009.940009:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891009.940012:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86a00/0x9161b78f8ec3f63c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1e21 expref: 12 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.940028:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:0.0:1788891009.940030:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788891009.940034:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec3f12d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1cc3 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.940044:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9da1f5361f00) 00010000:00010000:0.0:1788891009.940046:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891009.940050:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87a00/0x9161b78f8ec3fcda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1fef expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.940076:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9da1c2aeeb00) 00010000:00010000:0.0:1788891009.940078:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788891009.940082:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6f200/0x9161b78f8ec3f41a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1d95 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891009.940094:0:5802:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9da1f4c1d000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788891009.940106:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891009.940108:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891009.940110:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788891010.134755:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00100000:0.0:1788891010.134779:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:0.0:1788891010.134784:0:6689:0:(genops.c:885:class_export_put()) final put ffff9da1ca804800/671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:3.0:1788891010.134946:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1ca804800/671ae218-3c0c-4db9-9d11-9d6b732a0de5 for lustre-OST0000 00000020:00000080:3.0:1788891010.135011:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1d1b20800 for lustre-OST0000 00000001:00080000:1.0:1788891010.141580:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000020:00080000:1.0:1788891010.141595:0:5836:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00100000:1.0:1788891010.141626:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000001:00080000:1.0:1788891010.141631:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788891010.141640:0:5836:0:(genops.c:885:class_export_put()) final put ffff9da1f4c1d000/671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:2.0:1788891010.141683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f4c1d000/671ae218-3c0c-4db9-9d11-9d6b732a0de5 for lustre-MDT0000 00000020:00080000:3.0:1788891010.141723:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788891010.141738:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00000080:2.0:1788891010.141769:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1f4c19000 for lustre-MDT0000 00010000:00010000:3.0:1788891010.167553:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788891010.230501:0:11659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891010.230514:0:11659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891010.232244:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1788891010.232255:0:11659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788891010.614554:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996273024:0@lo:400:kworker.0 00000100:00100000:0.0:1788891010.614630:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891010.615057:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996273024 00000100:00100000:3.0:1788891010.615065:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996273024 00000100:00100000:3.0:1788891010.615124:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788891010.615148:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996273024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891010.615345:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3280:x1875787996273024:12345-0@lo:400:kworker.0 Request processed in 198us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.615353:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788891010.615861:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996273152:0@lo:400:kworker.0 00000100:00100000:3.0:1788891010.615899:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891010.616328:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996273152 00000100:00100000:1.0:1788891010.616335:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996273152 00000100:00100000:1.0:1788891010.616376:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788891010.616383:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996273152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891010.618109:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996273024:0@lo:400:kworker.0 00000100:00100000:0.0:1788891010.618202:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996273280:0@lo:400:kworker.0 00000100:00100000:0.0:1788891010.618259:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891010.618313:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996273280 00000100:00100000:0.0:1788891010.618319:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996273280 00000100:00100000:0.0:1788891010.618367:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788891010.618377:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996273280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891010.618424:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996273280:12345-0@lo:400:kworker.0 Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.618431:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788891010.618520:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891010.619034:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996273152:12345-0@lo:400:kworker.0 Request processed in 2648us (3131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891010.619045:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788891010.619063:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996273152:0@lo:400:kworker.0 00000100:00100000:3.0:1788891010.619081:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996273664:0@lo:400:kworker.0 00000100:00100000:3.0:1788891010.619117:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891010.619117:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996273280:0@lo:400:kworker.0 00000100:00100000:0.0:1788891010.619146:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996273536:0@lo:400:kworker.0 00000100:00100000:2.0:1788891010.619210:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996273664 00000100:00100000:2.0:1788891010.619215:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996273664 00000100:00100000:2.0:1788891010.619260:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788891010.619269:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996273664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891010.619313:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996273408:0@lo:400:kworker.0 00000100:00080000:3.0:1788891010.620053:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891010.620300:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891010.620339:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891010.620345:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996273664:12345-0@lo:400:kworker.0 Request processed in 1075us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891010.620382:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996273408 00000100:00100000:1.0:1788891010.620387:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996273408 00000100:00100000:3.0:1788891010.620444:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996273536 00000100:00100000:3.0:1788891010.620448:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996273536 00000100:00100000:3.0:1788891010.620484:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788891010.620492:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996273536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891010.620531:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875787996273536:12345-0@lo:400:kworker.0 Request processed in 40us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.620538:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1788891010.620552:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891010.620577:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996273664:0@lo:400:kworker.0 00000100:00100000:1.0:1788891010.621074:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788891010.621088:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996273408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891010.621223:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996273408:12345-0@lo:400:kworker.0 Request processed in 138us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891010.621293:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788891010.621347:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1875787996273536:0@lo:400:kworker.0 00000100:00100000:1.0:1788891010.621376:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788891010.621476:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788891010.621482:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da1ffa78e00, transno 4294967324 00000100:00100000:3.0:1788891010.621502:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996273408:0@lo:400:kworker.0 00000100:00100000:0.0:1788891010.808294:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891010.808324:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891010.808417:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914368 00000100:00100000:3.0:1788891010.808431:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914368 00000100:00100000:0.0:1788891010.808486:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891010.808952:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914240 00000100:00100000:0.0:1788891010.808966:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914496 00000100:00100000:3.0:1788891010.808974:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914240 00000100:00100000:0.0:1788891010.808974:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914496 00000100:00100000:3.0:1788891010.809009:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 22 00000100:00100000:3.0:1788891010.809021:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47df6031-18d1-4179-91e9-917028d5aced+12:2373:x1875787987914368:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891010.809037:0:6679:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788891010.809050:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:0.0:1788891010.809060:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+12:2375:x1875787987914240:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891010.809069:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891010.809087:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1f4edc800/0x9161b78f8ec3eec5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1be3 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.809106:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891010.809110:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6e800/0x9161b78f8ec3eecc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c0d expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.809124:0:6679:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891010.809425:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+10:2375:x1875787987914240:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 365us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.809434:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:0.0:1788891010.809455:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 24 00000100:00100000:0.0:1788891010.809462:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+9:2375:x1875787987914496:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891010.809469:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891010.809478:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1f4edd600/0x9161b78f8ec3f05b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1c92 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891010.809488:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891010.809504:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47df6031-18d1-4179-91e9-917028d5aced+8:2375:x1875787987914496:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 43us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891010.809519:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 24 00000100:00100000:3.0:1788891010.809608:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47df6031-18d1-4179-91e9-917028d5aced+7:2373:x1875787987914368:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 387us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.809616:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 22 00000100:00100000:1.0:1788891010.811981:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891010.812050:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987914752 00000100:00100000:2.0:1788891010.812059:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987914752 00000100:00100000:2.0:1788891010.812133:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 241 00000100:00100000:2.0:1788891010.812144:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+6:2371:x1875787987914752:12345-192.168.204.18@tcp:39:umount.0 00000020:00000080:2.0:1788891010.812234:0:6852:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eeda 00000100:00080000:3.0:1788891010.812242:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1788891010.812243:0:6852:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9da0c1183000: total 0 00000100:00080000:2.0:1788891010.812250:0:6852:0:(import.c:65:import_set_state_nolock()) ffff9da0c1184000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891010.812275:0:6852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1788891010.812280:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9da0c1183000: total 0 00010000:00010000:3.0:1788891010.812285:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891010.812333:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9da0c1183000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788891010.812371:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c870c500) 00010000:00010000:3.0:1788891010.812375:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891010.812383:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87200/0x9161b78f8ec3fe07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2043 expref: 5 pid: 6852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891010.812410:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9da0c1183000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788891010.812421:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891010.812423:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891010.812426:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891010.812688:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:852e3539-1359-4cf9-b701-3f696e6c6e5e+3:2371:x1875787987914752:12345-192.168.204.18@tcp:39:umount.0 Request processed in 545us (714us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788891010.812696:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 241 00000100:00100000:1.0:1788891010.825727:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891010.825858:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915008 00000100:00100000:3.0:1788891010.825868:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915008 00000100:00100000:3.0:1788891010.825985:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 278 00000100:00100000:3.0:1788891010.825996:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f01b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+7:2371:x1875787987915008:12345-192.168.204.18@tcp:251:umount.0 00000020:00000080:3.0:1788891010.826046:0:5810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3edd0 00000020:00010000:3.0:1788891010.826052:0:5810:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9da1fb999800: total 0 00000100:00080000:3.0:1788891010.826056:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9da1f4c1b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788891010.826142:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f01b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47df6031-18d1-4179-91e9-917028d5aced+3:2371:x1875787987915008:12345-192.168.204.18@tcp:251:umount.0 Request processed in 148us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891010.826150:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 278 00000020:00010000:1.0:1788891010.826387:0:5802:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9da1fb999800: total 0 00010000:00010000:1.0:1788891010.826441:0:5802:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9da1fb999800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788891010.826474:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29ef200/0x9161b78f8ec3ee86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a1bd5 expref: 2 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891010.826490:0:5802:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9da1fb999800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788891010.826499:0:5802:0:(genops.c:885:class_export_put()) final put ffff9da1fb999800/47df6031-18d1-4179-91e9-917028d5aced 00010000:00010000:1.0:1788891010.826519:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891010.826521:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891010.826523:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788891010.826576:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fb999800/47df6031-18d1-4179-91e9-917028d5aced for MGS 00000020:00000080:2.0:1788891010.826617:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1f4c1b000 for MGS 00000100:00100000:2.0:1788891011.127404:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891011.127427:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996273792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891011.127506:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891011.127578:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996273792 00000100:00100000:2.0:1788891011.127586:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996273792 00000100:00100000:2.0:1788891011.127636:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788891011.127653:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996273792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788891011.127692:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788891011.127739:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996273792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891011.127747:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788891011.127795:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996273792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788891011.190396:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788891011.902702:0:12942:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788891011.918484:0:12942:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788891011.918531:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.918543:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.918548:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.918553:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.918566:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788891011.918572:0:12942:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788891011.918592:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1788891011.918595:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788891011.918596:0:12942:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788891011.918601:0:12942:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788891011.918603:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.918609:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030e00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:3.0:1788891011.918612:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.918620:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788891011.918623:0:12942:0:(import.c:65:import_set_state_nolock()) ffff9da2016ae000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:3.0:1788891011.918626:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891011.918632:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788891011.918634:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788891011.918636:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788891011.918660:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.918667:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788891011.918698:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891011.918725:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c0030e00/0x9161b78f8ec3ee55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee5c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891011.918841:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996274048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891011.918847:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996273920:0@lo:39:umount.0 00010000:00010000:3.0:1788891011.918903:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891011.918906:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891011.918908:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891011.918964:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891011.918967:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891011.919008:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996274048 00000100:00100000:0.0:1788891011.919015:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996274048 00000100:00100000:3.0:1788891011.919061:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996273920 00000100:00100000:3.0:1788891011.919065:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996273920 00000100:00100000:0.0:1788891011.919075:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891011.919084:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+19:3279:x1875787996274048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788891011.919097:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788891011.919102:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788891011.919108:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875787996273920:12345-0@lo:39:umount.0 00010000:00010000:0.0:1788891011.919111:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29efa00/0x9161b78f8ec3ee5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ee55 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788891011.919130:0:5814:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ebf4 00010000:00010000:0.0:1788891011.919135:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788891011.919137:0:5814:0:(import.c:65:import_set_state_nolock()) ffff9da1f4c19800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788891011.919202:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:3279:x1875787996274048:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891011.919207:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3278:x1875787996273920:12345-0@lo:39:umount.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891011.919209:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788891011.919213:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788891011.919219:0:5814:0:(genops.c:885:class_export_put()) final put ffff9da1f4c18000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788891011.919234:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788891011.919240:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f4c18000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788891011.919296:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1f4c19800 for lustre-MDT0000 00000100:00080000:3.0:1788891011.919326:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da2016ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788891011.919334:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996273920:0@lo:39:umount.0 00000100:00080000:0.0:1788891011.919357:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788891011.919360:0:12942:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788891011.919364:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788891011.919418:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996274048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891011.920564:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920578:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920585:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920592:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920611:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891011.920616:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920639:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920647:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891011.920647:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920660:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920661:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920678:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031000 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788891011.920683:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920691:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891011.920694:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920700:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891011.920708:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920712:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920724:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891011.920725:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891011.920732:0:6678:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788891011.920746:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920763:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920771:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891011.920804:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920809:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788891011.920812:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c0031000/0x9161b78f8ec3ee63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920828:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920839:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920841:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891011.920848:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920857:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031a00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788891011.920863:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920867:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.920875:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920892:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891011.920902:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891011.920908:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891011.920910:0:6678:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788891011.920912:0:6678:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788891011.920928:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920935:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891011.920951:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920958:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c0031a00/0x9161b78f8ec3ed8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ed91 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.920981:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891011.920984:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.920988:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891011.920992:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6ec00 already unused, calling callback (ffffffffc1dd7c20) 00010000:00010000:0.0:1788891011.920996:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891011.920998:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.921012:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da202178800 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788891011.921016:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.921023:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891011.921030:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891011.921035:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788891011.921037:0:5802:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1788891011.921052:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.921058:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788891011.921066:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891011.921083:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891011.921084:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891011.921086:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891011.921136:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891011.921144:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891011.921149:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788891011.921151:0:6678:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788891011.921153:0:6678:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788891011.921154:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788891011.921161:0:12942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da202178800/0x9161b78f8ec3eb4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3eb53 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891011.921195:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891011.921199:0:12942:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1788891011.921203:0:12942:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788891011.921205:0:12942:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788891011.921235:0:12942:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788891011.921239:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788891011.921243:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891011.921248:0:12942:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788891011.921254:0:12942:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9da1f5300000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788891011.921261:0:12942:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9da0c1186000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788891011.921273:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1788891011.921277:0:12942:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9da0c1183000 852e3539-1359-4cf9-b701-3f696e6c6e5e 192.168.204.18@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788891011.921285:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788891011.921285:0:12942:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9da1f024cd28) has exports, disconnecting them 00000020:00080000:1.0:1788891011.921294:0:12942:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9da1f5300000), last request at 1788891010 00010000:00010000:2.0:1788891011.921297:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ec00/0x9161b78f8ec3f085 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3f08c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788891011.921302:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ed52 00010000:00010000:2.0:1788891011.921310:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891011.921314:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891011.921322:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891011.921322:0:12942:0:(import.c:65:import_set_state_nolock()) ffff9da1f5305800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788891011.921342:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996274176:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788891011.921375:0:12942:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9da1f5300000): rc 0 00000020:00000080:1.0:1788891011.921379:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1f5300000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788891011.921392:0:12942:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9da0c1186000), last request at 1788891010 00000020:00000080:1.0:1788891011.921403:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ec79 00000100:00100000:2.0:1788891011.921411:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891011.921412:0:12942:0:(import.c:65:import_set_state_nolock()) ffff9da0c12a5000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788891011.921422:0:12942:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9da0c1186000): rc 0 00000020:00000080:1.0:1788891011.921425:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da0c1186000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788891011.921433:0:12942:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd50838dfae0 00000100:00080000:1.0:1788891011.921460:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788891011.921464:0:12942:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00100000:2.0:1788891011.921467:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788891011.921476:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996274560:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1788891011.921482:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788891011.921500:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891011.921531:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996274304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891011.921555:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788891011.921555:0:12942:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788891011.921573:0:12942:0:(import.c:65:import_set_state_nolock()) ffff9da1c5241000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788891011.921580:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891011.921588:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996274432:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788891011.921589:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788891011.921594:0:12942:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788891011.921605:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788891011.921616:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891011.921653:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996274176 00000100:00100000:2.0:1788891011.921659:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996274176 00000100:00080000:1.0:1788891011.921670:0:12942:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788891011.921682:0:12942:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc5800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788891011.921694:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996274560 00000100:00100000:2.0:1788891011.921698:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996274560 00000100:00100000:2.0:1788891011.921717:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996274304 00000100:00100000:2.0:1788891011.921720:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996274304 00000020:00080000:1.0:1788891011.921722:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9da1f024cd28) has no exports 00000100:00100000:2.0:1788891011.921734:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996274432 00000100:00100000:2.0:1788891011.921737:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996274432 00000100:00100000:2.0:1788891011.921753:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1788891011.921758:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f5300000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1788891011.921764:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+21:3280:x1875787996274176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891011.921777:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891011.921793:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6f800/0x9161b78f8ec3ee6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ee63 expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788891011.921805:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da0c1186000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1788891011.921808:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1788891011.921847:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1f5305800 for lustre-MDT0000 00000020:00000080:1.0:1788891011.921855:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da0c12a5000 for lustre-MDT0000 00000100:00100000:2.0:1788891011.921860:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+20:3280:x1875787996274176:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891011.921900:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788891011.921910:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+20:3280:x1875787996274560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891011.921920:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891011.921931:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6e400/0x9161b78f8ec3f08c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3f085 expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891011.921946:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788891011.921947:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891011.921979:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788891011.921980:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+18:3280:x1875787996274560:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891011.921987:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+18:3281:x1875787996274304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891011.922001:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788891011.922002:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788891011.922020:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788891011.922027:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+17:3281:x1875787996274432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891011.922037:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891011.922045:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c13f9a00/0x9161b78f8ec3eb53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3eb4c expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891011.922056:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891011.922081:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c13f9800/0x9161b78f8ec3ed91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ed8a expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891011.922088:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68b804f9-71ae-42dc-a11e-677332e27dfa+16:3281:x1875787996274432:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891011.922097:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788891011.922099:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891011.922125:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891011.922132:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68b804f9-71ae-42dc-a11e-677332e27dfa+14:3281:x1875787996274304:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891011.922140:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788891011.922220:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996274432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891011.922232:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68b804f9-71ae-42dc-a11e-677332e27dfa:3281:1875787996274304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891011.922256:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996274688:0@lo:9:umount.0 00000100:00100000:2.0:1788891011.922268:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996274560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891011.922279:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68b804f9-71ae-42dc-a11e-677332e27dfa:3280:1875787996274176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891011.922297:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891011.922323:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996274816:0@lo:9:umount.0 00000100:00100000:2.0:1788891011.922325:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996274688 00000100:00100000:2.0:1788891011.922332:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996274688 00000100:00100000:1.0:1788891011.922351:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891011.922377:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996274816 00000100:00100000:2.0:1788891011.922381:0:11963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996274816 00000100:00100000:2.0:1788891011.922408:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788891011.922416:0:11963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875787996274688:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788891011.922439:0:11963:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ecc6 00000100:00080000:2.0:1788891011.922448:0:11963:0:(import.c:65:import_set_state_nolock()) ffff9da1c5244000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788891011.922479:0:11963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788891011.922505:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788891011.922517:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875787996274816:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788891011.922533:0:6664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3edc9 00000100:00080000:1.0:1788891011.922539:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9da1fb99a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788891011.922559:0:6664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788891011.922736:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3278:x1875787996274816:12345-0@lo:9:umount.0 Request processed in 221us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891011.922744:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788891011.922787:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc5800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788891011.922798:0:3278:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788891011.922808:0:3278:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891011.922812:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996274816:0@lo:9:umount.0 00000100:00080000:1.0:1788891011.922865:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788891011.922879:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891011.922927:0:11963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3278:x1875787996274688:12345-0@lo:9:umount.0 Request processed in 512us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891011.922935:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788891011.922951:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891011.923377:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891011.924119:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1c5241000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788891011.924144:0:3278:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788891011.924146:0:3278:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788891011.924151:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996274688:0@lo:9:umount.0 00000020:00080000:3.0:1788891011.933541:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9da1f024cd28) has no exports 00000020:00000080:3.0:1788891011.984185:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eba7 00000020:00000080:3.0:1788891011.984200:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1f4e26800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788891011.984217:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788891011.984233:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f4e26800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788891011.984264:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891011.984274:0:12942:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788891011.984279:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9da1fb8c19b8) has no exports 00000020:00000080:2.0:1788891011.984572:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eba0 00000020:00000080:2.0:1788891011.984578:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1fb8da800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788891011.984632:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891011.984639:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788891011.984642:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da201685000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788891011.984645:0:12942:0:(genops.c:844:class_export_destroy()) destroying export ffff9da201685000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788891011.984650:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788891011.984660:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fb8da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788891012.214347:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891013.238716:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788891014.239826:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788891014.239835:0:7624:0:(genops.c:885:class_export_put()) final put ffff9da1fb99e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788891014.239863:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:3.0:1788891014.239865:0:7624:0:(genops.c:885:class_export_put()) final put ffff9da0c1180000/671ae218-3c0c-4db9-9d11-9d6b732a0de5 00000020:00000080:2.0:1788891014.239921:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fb99e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788891014.239966:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da0c1180000/671ae218-3c0c-4db9-9d11-9d6b732a0de5 for lustre-OST0001 00000020:00000080:2.0:1788891014.239981:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1fb99a000 for lustre-OST0001 00000020:00000080:2.0:1788891014.239986:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da0c1182000 for lustre-OST0001 00010000:00010000:0.0:1788891014.262955:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788891015.258068:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788891015.258078:0:6689:0:(genops.c:885:class_export_put()) final put ffff9da1c5245000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788891015.258224:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1c5245000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788891015.258281:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1c5244000 for lustre-OST0000 00000001:00100000:1.0:1788891015.261050:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 852e3539-1359-4cf9-b701-3f696e6c6e5e 00000001:00080000:1.0:1788891015.261068:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788891015.261073:0:5836:0:(genops.c:885:class_export_put()) final put ffff9da0c1183000/852e3539-1359-4cf9-b701-3f696e6c6e5e 00000020:00000080:0.0:1788891015.261294:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da0c1183000/852e3539-1359-4cf9-b701-3f696e6c6e5e for lustre-MDT0000 00000020:00000080:0.0:1788891015.261463:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da0c1184000 for lustre-MDT0000 00010000:00010000:1.0:1788891015.286384:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891015.735137:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996275072:0@lo:400:kworker.0 00000100:00100000:1.0:1788891015.735212:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788891015.735230:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996274944:0@lo:400:kworker.0 00000100:00100000:0.0:1788891015.735235:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891015.735324:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996275072 00000100:00100000:2.0:1788891015.735332:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996275072 00000100:00100000:2.0:1788891015.735368:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788891015.735376:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875787996275072:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788891015.735384:0:5816:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788891015.735468:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996275200:0@lo:400:kworker.0 00000100:00100000:1.0:1788891015.737243:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891015.737326:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996274944 00000100:00100000:1.0:1788891015.737334:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996274944 00000100:00100000:1.0:1788891015.737381:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788891015.737390:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f0193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:3279:x1875787996274944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891015.737448:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f0193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68b804f9-71ae-42dc-a11e-677332e27dfa+14:3279:x1875787996274944:12345-0@lo:400:kworker.0 Request processed in 60us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891015.737455:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788891015.737516:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996274944:0@lo:400:kworker.0 00000100:00100000:2.0:1788891015.738979:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3281:x1875787996275072:12345-0@lo:400:kworker.0 Request processed in 3597us (3742us total) trans 0 rc -107/-107 00000100:00080000:0.0:1788891015.738980:0:3281:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788891015.738990:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9da0c1181800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1788891015.738995:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:02000400:0.0:1788891015.738999:0:3281:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788891015.739267:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891015.740910:0:6852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996275200 00000100:00100000:1.0:1788891015.740923:0:6852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996275200 00000100:00100000:1.0:1788891015.740976:0:6852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788891015.740983:0:6852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3282:x1875787996275200:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788891015.741004:0:6852:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788891015.741079:0:6852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3282:x1875787996275200:12345-0@lo:400:kworker.0 Request processed in 95us (1813us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788891015.741087:0:6852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788891015.743848:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788891015.743855:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788891015.743860:0:3282:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788891015.743866:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891015.743870:0:3282:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 97 00000100:00080000:2.0:1788891015.743896:0:3282:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9da1f9bc2800 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:2.0:1788891015.743934:0:3282:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f52c2d80 x1875787996275328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891015.743957:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1875787996275200:0@lo:400:kworker.0 00000100:00100000:1.0:1788891015.744048:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1875787996275328:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788891015.744112:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891015.744684:0:11412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996275328 00000100:00100000:2.0:1788891015.744691:0:11412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996275328 00000100:00100000:2.0:1788891015.744738:0:11412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788891015.744756:0:11412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3278:x1875787996275328:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788891015.744773:0:11412:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788891015.759029:0:3281:0:(import.c:65:import_set_state_nolock()) ffff9da0c1181800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891015.759040:0:3281:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 88 00000100:00080000:0.0:1788891015.759049:0:3281:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9da0c1181800 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:0.0:1788891015.759088:0:3281:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da201f8df80 x1875787996275456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891015.759237:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1875787996275456:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788891015.759315:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891015.759998:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996275456 00000100:00100000:3.0:1788891015.760006:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996275456 00000100:00100000:3.0:1788891015.760047:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788891015.760055:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1875787996275456:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788891015.760072:0:5816:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788891015.760181:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996275072:0@lo:400:kworker.0 00000100:00100000:3.0:1788891015.761165:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1875787996275456:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 1106us (1846us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788891015.761186:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1788891015.761239:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da0c1181800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891015.761246:0:3278:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891015.761250:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1875787996275456:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788891015.778835:0:11412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3278:x1875787996275328:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 34069us (34713us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891015.778849:0:11412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788891015.779546:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891015.779553:0:3278:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891015.779558:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1875787996275328:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1788891016.310410:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891017.334800:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788891018.039238:0:12942:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9da1f9bb67e0 - data ffff9da1cda8fca8/ffff9da1f4f90000 00000020:01000000:1.0:1788891018.039385:0:12942:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9da1c413c1e0 - data ffff9da1e73e4000/ffff9da1d0689400 00000001:00000004:1.0:1788891018.045681:0:12942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788891018.091091:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788891018.091099:0:12942:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788891018.091191:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788891018.091204:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788891018.091817:0:6850:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788891018.091822:0:6850:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788891018.091831:0:6850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788891018.093010:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788891018.093014:0:12942:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788891018.093027:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788891018.093029:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788891018.093427:0:8134:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788891018.093431:0:8134:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788891018.093441:0:8134:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788891018.126015:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eb6f 00000020:00000080:3.0:1788891018.126027:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1fa415800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788891018.126773:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fa415800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788891018.127202:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eb84 00000020:00000080:3.0:1788891018.127209:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1fa411800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788891018.127218:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788891018.127224:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891018.127231:0:12942:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788891018.127235:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9da1f02499b8) has no exports 00000004:01000000:3.0:1788891018.127431:0:12942:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788891018.127438:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3edb4 00000020:00000080:3.0:1788891018.127442:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1fa400000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788891018.127455:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788891018.127459:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891018.127464:0:12942:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788891018.127467:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9da1cae5b370) has no exports 00000020:00000080:3.0:1788891018.127472:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3edad 00000020:00000080:3.0:1788891018.127475:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1f9bc0000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788891018.127805:0:12942:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788891018.127810:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000020:00000080:0.0:1788891018.127906:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fa411800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788891018.127912:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fa400000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788891018.127916:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f9bc0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788891018.127939:0:12942:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788891018.127944:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788891018.127947:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788891018.127980:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891018.127987:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891018.127992:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ecbf 00000020:00000080:3.0:1788891018.127996:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1c5241800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788891018.127999:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788891018.128002:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891018.128005:0:12942:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788891018.128007:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9da1cae599b8) has no exports 00000020:00000080:3.0:1788891018.128011:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ecb8 00000020:00000080:3.0:1788891018.128013:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1c5247800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788891018.128448:0:12942:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788891018.128450:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788891018.128453:0:12942:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788891018.128456:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788891018.128458:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788891018.128478:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891018.128483:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891018.128509:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891018.128512:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891018.128515:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1f0272000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788891018.128523:0:12942:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f0272000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788891018.128532:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788891018.128588:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1f9bc5800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788891018.128594:0:485:0:(genops.c:885:class_export_put()) final put ffff9da1f9bc6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788891018.128596:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f9bc6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788891018.128600:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788891018.128659:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1c5241800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788891018.128664:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1c5247800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788891018.128668:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1c5241000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788891018.128672:0:485:0:(genops.c:885:class_export_put()) final put ffff9da0c12a4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788891018.128673:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da0c12a4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788891018.128677:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891018.128857:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eb8b 00000020:00000080:3.0:1788891018.128862:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1fa415000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788891018.128873:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788891018.128877:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891018.128880:0:12942:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788891018.128882:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9da1fa41cd28) has no exports 00000020:00000080:3.0:1788891018.128902:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891018.128905:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788891018.128908:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eb92 00000020:00000080:3.0:1788891018.128936:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1fa414000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788891018.128944:0:12942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9da1c9db0800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788891018.128946:0:12942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1c9db0800 3 00000020:01000004:3.0:1788891018.128949:0:12942:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9da1c9db0800 from lustre-MDT0000 00000020:00000080:3.0:1788891018.128963:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891018.128967:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788891018.128969:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1fa416000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788891018.129042:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fa415000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788891018.129046:0:485:0:(genops.c:885:class_export_put()) final put ffff9da1fa414800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788891018.129048:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fa414800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788891018.129052:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788891018.129127:0:12942:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fa416000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788891018.129134:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788891018.129157:0:12942:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788891018.129161:0:12942:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788891018.129164:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788891018.129183:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891018.129186:0:12942:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788891018.129193:0:12942:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9da1d0e5b000 68b804f9-71ae-42dc-a11e-677332e27dfa 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891018.129198:0:12942:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9da1c8b7cd28) has exports, disconnecting them 00000020:00080000:3.0:1788891018.129202:0:12942:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9da1d0e5b000), last request at 1788890858 00000020:00000080:3.0:1788891018.129216:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eb30 00000020:00010000:3.0:1788891018.129219:0:12942:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9da1d0e5b000: total 2 00000100:00080000:3.0:1788891018.129223:0:12942:0:(import.c:65:import_set_state_nolock()) ffff9da1d0e5b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788891018.129239:0:12942:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9da1d0e5b000): rc 0 00000020:00080000:3.0:1788891018.129243:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9da1c8b7cd28) has no exports 00000100:00100000:3.0:1788891018.129400:0:5810:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9da1c8b6c400:5810] 2 exiting: rc = 0 00000020:00000080:0.0:1788891018.129712:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fa414000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788891018.129771:0:6678:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9da1d0e5b000: total 0 00010000:00010000:1.0:1788891018.129808:0:6678:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9da1d0e5b000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788891018.129842:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0031400/0x9161b78f8ec3f070 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3f069 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891018.129861:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29ee600/0x9161b78f8ec3ee24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ee1d expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891018.129875:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29ef400/0x9161b78f8ec3ee40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ee39 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891018.129897:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0031200/0x9161b78f8ec3f07e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3f077 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891018.129910:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c29eec00/0x9161b78f8ec3ee32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ee2b expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891018.129920:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0031c00/0x9161b78f8ec3ee4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ee47 expref: 4 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891018.129929:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c13f8a00/0x9161b78f8ec3ec2c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ec25 expref: 3 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891018.129941:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6fc00/0x9161b78f8ec3ee78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9161b78f8ec3ee71 expref: 2 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891018.129951:0:6678:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9da1d0e5b000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788891018.129964:0:6678:0:(genops.c:885:class_export_put()) final put ffff9da1d0e5b000/68b804f9-71ae-42dc-a11e-677332e27dfa 00010000:00010000:1.0:1788891018.129984:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891018.129987:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891018.129989:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788891018.130005:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1d0e5b000/68b804f9-71ae-42dc-a11e-677332e27dfa for MGS 00000100:00100000:1.0:1788891018.130021:0:5808:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9da1d0624c00:5808] 1 exiting: rc = 0 00000020:00000080:0.0:1788891018.130047:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1d0e5b800 for MGS 00000100:00100000:1.0:1788891018.130088:0:5807:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9da1f011b200:5807] 0 exiting: rc = 1 00000100:00100000:1.0:1788891018.130141:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130150:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130157:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130163:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130199:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130208:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130216:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130226:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130241:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130248:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130263:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130270:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130277:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130281:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130287:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130292:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130298:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130303:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130309:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130314:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130320:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130325:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130331:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130337:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130342:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130348:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130353:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130359:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130364:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130370:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130377:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130385:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130393:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130401:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130411:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130417:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130426:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130431:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130438:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130443:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130455:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130459:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130464:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130476:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130481:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130489:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130496:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130501:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130507:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130512:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130517:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130522:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130527:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130533:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130538:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130543:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130549:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130555:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130560:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130565:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130571:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130575:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130580:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.130586:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788891018.131042:0:12942:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788891018.131045:0:12942:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788891018.131888:0:12942:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9da1f9bb6c60 - data ffff9da1f8c3c360/ffff9da1f4ceb400 00000020:01000000:0.0:1788891018.132005:0:12942:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9da1c92cd540 - data ffff9da1e73871b0/ffff9da1d14ba000 00000020:00000080:0.0:1788891018.132816:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eb14 00000020:00000080:0.0:1788891018.132825:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1d0e59800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788891018.132870:0:12942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9da1c9db0800 from MGS, refs=2 00000020:01000004:0.0:1788891018.132875:0:12942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1c9db0800 2 00000020:01000004:0.0:1788891018.132879:0:12942:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9da1c9db0800 from MGS 00000020:00000080:0.0:1788891018.132909:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891018.132915:0:12942:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788891018.132918:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1d0e5f000/MGS 00000020:00000080:0.0:1788891018.132921:0:12942:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1d0e5f000/MGS for MGS 00000020:01000000:0.0:1788891018.132926:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788891018.132984:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788891018.132987:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891018.132992:0:12942:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788891018.132997:0:12942:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9da2016ad800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788891018.133002:0:12942:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9da1c8b7b370) has exports, disconnecting them 00000020:00080000:0.0:1788891018.133007:0:12942:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9da2016ad800), last request at 1788890858 00000020:00000080:0.0:1788891018.133011:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ebdf 00000020:00080000:0.0:1788891018.133020:0:12942:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9da2016ad800): rc 0 00000020:00000080:0.0:1788891018.133025:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da2016ad800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788891018.133268:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1d0e59800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788891018.135890:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da2016ad800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788891018.136397:0:12942:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788891018.136403:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788891018.136408:0:12942:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788891018.136413:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788891018.136457:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da2016ae000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788891018.136705:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891018.136713:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788891018.136719:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da2016ab800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788891018.136722:0:12942:0:(genops.c:844:class_export_destroy()) destroying export ffff9da2016ab800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788891018.136733:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788891018.136800:0:12942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1c9db0800 1 00000020:00000080:2.0:1788891018.136813:0:12942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eb06 00000020:00000080:2.0:1788891018.136819:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1d0e5e800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788891018.136837:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788891018.136841:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891018.136845:0:12942:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788891018.136849:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9da1c8b799b8) has no exports 00000020:00000080:3.0:1788891018.136961:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1d0e5e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788891018.159095:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891018.159110:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788891018.159116:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1c9db7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788891018.159120:0:12942:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1c9db7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788891018.159134:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788891018.159283:0:12942:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9da1c9db2800 00000020:01000000:3.0:1788891018.159307:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788891018.159311:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891018.159316:0:12942:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788891018.159319:0:12942:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9da1f0248000) has no exports 00000100:00100000:3.0:1788891018.159396:0:5815:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9da1f0217000:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1788891018.159431:0:6852:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9da201b49000:6852] 3 exiting: rc = 0 00000100:00100000:3.0:1788891018.159543:0:5816:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9da1d0e40a00:5816] 2 exiting: rc = 0 00000100:00100000:2.0:1788891018.159550:0:11412:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9da1ffb25800:11412] 4 exiting: rc = 0 00000100:00100000:0.0:1788891018.161744:0:5814:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9da1d36a7200:5814] 0 exiting: rc = 1 00000100:00100000:3.0:1788891018.162002:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162009:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162014:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162020:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162024:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162029:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162035:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162041:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162046:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162051:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162069:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162075:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162080:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162085:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162090:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162110:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162115:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162121:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162127:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162133:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162138:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162144:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162150:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162157:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162163:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162198:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162207:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162213:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162220:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162225:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162230:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162236:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162241:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162246:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162251:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162258:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162263:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162268:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162273:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162280:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162290:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162296:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162302:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162308:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162313:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162319:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162324:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162330:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162337:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162342:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162358:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162365:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162371:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162380:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162385:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162392:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162397:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162403:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162409:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162414:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162420:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162425:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162431:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.162436:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.165947:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9da1d0e41c00:5818] 1 exiting: rc = 0 00000100:00100000:2.0:1788891018.166252:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9da1f0217200:5817] 0 exiting: rc = 1 00000100:00100000:3.0:1788891018.166360:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166369:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166375:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166380:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166387:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166393:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166404:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166409:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166416:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166422:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166428:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166435:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166442:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166447:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166452:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166456:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166461:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166465:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166470:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166475:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166479:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166495:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166501:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166506:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166512:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166521:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166569:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166575:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166580:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166584:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166589:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166596:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166601:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166606:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166611:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166616:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166621:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166625:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166630:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166636:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166641:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166646:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166650:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166655:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166661:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166666:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166671:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166675:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166680:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166685:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166690:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166704:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166710:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166715:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166720:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166726:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166736:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166741:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166746:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166750:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166754:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166759:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166763:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.166767:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891018.167447:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9da1c8c04e00:5819] 0 exiting: rc = 1 00000100:00100000:1.0:1788891018.167454:0:11998:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9da1ffbab200:11998] 2 exiting: rc = 0 00000100:00100000:0.0:1788891018.167565:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9da1d0e40000:5820] 1 exiting: rc = 0 00000100:00100000:3.0:1788891018.167634:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167641:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167648:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167653:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167659:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167665:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167671:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167677:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167683:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167700:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167706:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167714:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167743:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167761:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167768:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167773:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167778:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167783:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167788:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167793:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167799:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167804:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167809:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167814:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167820:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167836:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167842:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167854:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167859:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167864:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167870:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167875:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167882:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167888:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167898:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167903:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167912:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167928:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167934:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167939:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167945:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167950:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167977:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167983:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167989:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.167995:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168000:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168006:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168011:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168027:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168033:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168038:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168044:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168049:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168054:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168068:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168074:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168080:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168085:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168090:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168095:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168110:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168120:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.168127:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.183162:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9da1c8c04600:5821] 0 exiting: rc = 1 00000100:00100000:1.0:1788891018.183221:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9da1f02e6200:5822] 1 exiting: rc = 0 00000100:00100000:1.0:1788891018.183317:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183324:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183330:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183335:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183340:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183345:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183350:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183356:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183361:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183366:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183371:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183376:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183402:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183407:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183412:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183417:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183423:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183428:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183433:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183438:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183443:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183449:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183455:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183461:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183466:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183482:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183487:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183492:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183497:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183502:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183507:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183511:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183516:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183521:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183526:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183532:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183538:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183542:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183547:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183552:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183556:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183561:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183566:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183571:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183576:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183581:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183587:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183600:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183605:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183610:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183615:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183619:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183624:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183629:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183634:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183639:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183644:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183649:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183655:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183660:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183665:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183671:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183676:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891018.183681:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891018.184126:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9da1f02e7e00:5824] 1 exiting: rc = 0 00000100:00100000:0.0:1788891018.184766:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9da1f02d9800:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1788891018.185229:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185236:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185243:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185251:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185256:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185270:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185275:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185280:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185285:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185290:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185296:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185301:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185306:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185311:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185318:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185324:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185330:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185336:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185343:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185352:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185360:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185370:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185375:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185381:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185386:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185391:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185395:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185401:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185406:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185800:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185807:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185815:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185822:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185826:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185831:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185836:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185841:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185846:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185851:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185861:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185879:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185885:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185890:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185895:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185900:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185905:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185909:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185916:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185921:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185926:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185931:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185936:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.185940:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186182:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186193:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186198:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186203:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186207:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186214:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186220:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186224:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186230:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186234:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.186240:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891018.187106:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9da1f02d8c00:5825] 0 exiting: rc = 1 00000100:00100000:2.0:1788891018.187156:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9da1f02d2000:5826] 1 exiting: rc = 0 00000100:00100000:3.0:1788891018.187368:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187378:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187385:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187391:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187397:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187404:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187411:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187418:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187425:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187431:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187437:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187444:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187450:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187456:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187463:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187468:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187473:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187477:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187482:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187486:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187491:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187495:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187500:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187505:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187509:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187513:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187518:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187522:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187526:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187531:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187535:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187540:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187544:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187557:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187561:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187567:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187574:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187580:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187586:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187591:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187597:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187604:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187610:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187620:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187629:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187645:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187655:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187660:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187665:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187669:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187673:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187678:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187684:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187690:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187711:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187718:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187723:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187730:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187738:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187745:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187753:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187759:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187766:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.187774:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.188330:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9da1f0207800:5829] 2 exiting: rc = 0 00000100:00100000:2.0:1788891018.188396:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9da1f02d2c00:5828] 1 exiting: rc = 0 00000100:00100000:0.0:1788891018.188922:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9da1f0206800:5827] 0 exiting: rc = 1 00000100:00100000:3.0:1788891018.189343:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189352:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189359:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189379:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189385:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189392:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189400:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189408:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189415:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189422:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189429:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189438:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189446:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189455:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189463:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189471:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189477:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189483:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189489:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189495:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189518:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189525:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189530:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189540:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189549:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189559:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189568:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189575:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189580:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189586:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189603:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189609:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189615:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189620:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189626:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189634:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189648:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189661:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189677:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189690:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189899:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189908:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189920:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189929:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189962:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189980:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.189988:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190000:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190008:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190016:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190032:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190046:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190054:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190060:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190067:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190073:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190078:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190090:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190096:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190101:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190106:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190113:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190118:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891018.190125:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788891018.195201:0:12942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891018.195214:0:12942:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788891018.195220:0:12942:0:(genops.c:885:class_export_put()) final put ffff9da1ca800800/MDS_uuid 00000020:00000080:3.0:1788891018.195321:0:12942:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1ca800800/MDS_uuid for MDS 00000020:01000000:3.0:1788891018.195328:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788891018.195495:0:12942:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788891018.359364:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891019.382988:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788891020.141692:0:13098:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788891020.155290:0:13098:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788891020.155337:0:13098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.155350:0:13098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.155357:0:13098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.155365:0:13098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.155388:0:13098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788891020.155393:0:13098:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788891020.155426:0:13098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891020.155430:0:13098:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788891020.155436:0:13098:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788891020.155443:0:13098:0:(import.c:65:import_set_state_nolock()) ffff9da0c1181800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788891020.155447:0:13098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788891020.155449:0:13098:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788891020.155451:0:13098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788891020.156318:0:13098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.156332:0:13098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.156338:0:13098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.156344:0:13098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.156368:0:13098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788891020.156373:0:13098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.156379:0:13098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.156384:0:13098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.156390:0:13098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891020.156410:0:13098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788891020.156414:0:13098:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788891020.156430:0:13098:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788891020.156434:0:13098:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788891020.156437:0:13098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891020.156442:0:13098:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788891020.156446:0:13098:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9da1c8b78000) has no exports 00000020:00080000:1.0:1788891020.156470:0:13098:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9da1c8b78000) has no exports 00010000:00010000:2.0:1788891020.158314:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788891020.158326:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158337:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6ea00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788891020.158341:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158351:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891020.158358:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891020.158364:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891020.158367:0:6678:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788891020.158370:0:6678:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788891020.158419:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158438:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891020.158478:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158485:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ea00/0x9161b78f8ec3ee39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee40 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158502:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891020.158505:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158511:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6ee00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788891020.158514:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158520:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891020.158526:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891020.158531:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788891020.158534:0:6678:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788891020.158536:0:6678:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000100:00100000:3.0:1788891020.158550:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996275584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891020.158552:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158561:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891020.158568:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158584:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec3ee47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3ee4e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158593:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891020.158597:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158603:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd200 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788891020.158607:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158613:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891020.158619:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891020.158625:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788891020.158631:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788891020.158631:0:6678:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788891020.158634:0:6678:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788891020.158648:0:6678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158668:0:6678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891020.158687:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158693:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3f077 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9161b78f8ec3f07e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891020.158710:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891020.158712:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891020.158714:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891020.158871:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788891020.158882:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996275712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891020.158916:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891020.158962:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996275584 00000100:00100000:3.0:1788891020.158971:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996275584 00000100:00100000:3.0:1788891020.159012:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996275712 00000100:00100000:3.0:1788891020.159016:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996275712 00000100:00100000:3.0:1788891020.159034:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788891020.159043:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3279:x1875787996275584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788891020.159050:0:6679:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788891020 with bad export cookie 10475856035443895088 00000100:00100000:2.0:1788891020.159084:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788891020.159095:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996275840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891020.159125:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891020.159147:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996275840 00000100:00100000:2.0:1788891020.159150:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996275840 00000100:00100000:2.0:1788891020.159185:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788891020.159191:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3279:x1875787996275712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788891020.159197:0:5799:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788891020 with bad export cookie 10475856035443895088 00000100:00100000:2.0:1788891020.159239:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3279:x1875787996275712:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (324us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788891020.159246:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788891020.159264:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788891020.159268:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3282:x1875787996275840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788891020.159272:0:5799:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788891020 with bad export cookie 10475856035443895088 00000100:00100000:2.0:1788891020.159298:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3282:x1875787996275840:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (173us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788891020.159304:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788891020.159477:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788891020.159482:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9da1ca804000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788891020.159485:0:3282:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788891020.159569:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891020.159576:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788891020.159771:0:13098:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9da1ffa6a900 - data ffff9da1f8c21798/ffff9da1dfcef800 00000020:01000000:1.0:1788891020.159966:0:13098:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9da1c8bf26c0 - data ffff9da1f042e000/ffff9da1f4f91400 00000100:00100000:3.0:1788891020.167921:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3279:x1875787996275584:12345-0@lo:103:ldlm_bl.0 Request processed in 8873us (9289us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788891020.167934:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788891020.170349:0:3279:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788891020.181681:0:3282:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.118@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788891020.181688:0:3282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788891020.181716:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9da1f52c3800 x1875787996275584/t0(0) o103->MGC192.168.204.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788891036 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891020.181732:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9da1f52c1880 x1875787996275712/t0(0) o103->MGC192.168.204.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788891036 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891020.181741:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9da1f52c0000 x1875787996275840/t0(0) o103->MGC192.168.204.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788891036 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788891020.181814:0:3279:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9da1ca804000 already not connected (conn 1, was 1): DISCONN 10000000:01000000:2.0:1788891020.181849:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788891020.181853:0:3282:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788891020.181854:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788891020.181858:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9da1ca804000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891020.181864:0:3282:0:(import.c:510:import_select_connection()) MGC192.168.204.118@tcp: connect to NID 0@lo last attempt 82 00000100:00080000:2.0:1788891020.181873:0:3282:0:(import.c:624:import_select_connection()) MGC192.168.204.118@tcp: import ffff9da1ca804000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:2.0:1788891020.181905:0:3282:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f52c0380 x1875787996275968/t0(0) o250->MGC192.168.204.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891020.181948:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68b804f9-71ae-42dc-a11e-677332e27dfa:3282:1875787996275840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891020.182011:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996275584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891020.182035:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68b804f9-71ae-42dc-a11e-677332e27dfa:3279:1875787996275712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891020.182325:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68b804f9-71ae-42dc-a11e-677332e27dfa:3278:1875787996275968:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788891020.182374:0:3278:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875787996275968 offset 0 length 520: 4 00100000:10000000:1.0:1788891020.195721:0:13098:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788891020.213387:0:13098:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ec48 00000020:00000080:1.0:1788891020.213399:0:13098:0:(genops.c:885:class_export_put()) final put ffff9da1f4e33000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788891020.213422:0:13098:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9da1f4e26000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788891020.213426:0:13098:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1f4e26000 2 00000020:01000004:1.0:1788891020.213430:0:13098:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9da1f4e26000 from lustre-OST0000 00000020:00000080:1.0:1788891020.213462:0:13098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788891020.213472:0:13098:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788891020.213475:0:13098:0:(genops.c:885:class_export_put()) final put ffff9da1f4c1e800/lustre-OST0000_UUID 00000020:00000080:1.0:1788891020.213477:0:13098:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f4c1e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788891020.213484:0:13098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1788891020.213627:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f4e33000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1788891020.213788:0:13098:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788891020.213792:0:13098:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788891020.213795:0:13098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788891020.213799:0:13098:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788891020.213805:0:13098:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9da0c1185800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788891020.213816:0:13098:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9da1fa4199b8) has exports, disconnecting them 00000020:00080000:1.0:1788891020.213820:0:13098:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9da0c1185800), last request at 1788890864 00000020:00000080:1.0:1788891020.213824:0:13098:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ec72 00000020:00080000:1.0:1788891020.213833:0:13098:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9da0c1185800): rc 0 00000020:00000080:1.0:1788891020.213837:0:13098:0:(genops.c:885:class_export_put()) final put ffff9da0c1185800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788891020.214194:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da0c1185800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788891020.215374:0:13098:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788891020.215381:0:13098:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788891020.215385:0:13098:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788891020.215391:0:13098:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788891020.215622:0:13098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891020.215628:0:13098:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788891020.215633:0:13098:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1f4e26000 1 00000020:00000080:0.0:1788891020.215639:0:13098:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ec02 00000020:00000080:0.0:1788891020.215644:0:13098:0:(genops.c:885:class_export_put()) final put ffff9da1fa410800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788891020.215676:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da0c1181800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788891020.215683:0:8:0:(genops.c:885:class_export_put()) final put ffff9da0c1184800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788891020.215686:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da0c1184800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788891020.215691:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788891020.215848:0:13098:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788891020.215853:0:13098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891020.215858:0:13098:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788891020.215861:0:13098:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9da1fa41b370) has no exports 00000020:00000080:3.0:1788891020.216267:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fa410800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788891020.232812:0:13098:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891020.232828:0:13098:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788891020.232834:0:13098:0:(genops.c:885:class_export_put()) final put ffff9da1d0e5d800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788891020.232838:0:13098:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1d0e5d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788891020.232844:0:13098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788891020.232958:0:13098:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9da1f4e22000 00000020:02000400:0.0:1788891020.233003:0:13098:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788891020.406805:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788891020.854406:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788891020.854413:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788891020.854418:0:8:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788891020.854426:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 239 00000100:00080000:1.0:1788891020.854430:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788891020.854436:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9da1f9bc2800 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:1.0:1788891020.854469:0:8:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f52c8380 x1875787996276096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891020.854552:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1875787996276096:0@lo:38:kworker.0 00000400:00000100:3.0:1788891020.854617:0:3278:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875787996276096 offset 0 length 520: 4 00010000:00010000:0.0:1788891021.435084:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788891022.074672:0:13247:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788891022.088397:0:13247:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788891022.088511:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.088526:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.088547:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.088553:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.088576:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891022.088648:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891022.088656:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.088665:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6f400 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788891022.088669:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.088679:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891022.088692:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891022.088698:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788891022.088701:0:5802:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1788891022.088712:0:5802:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9da1ca804000 00010000:00010000:0.0:1788891022.088716:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891022.088724:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891022.088726:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891022.088728:0:5802:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891022.089764:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6f400/0x9161b78f8ec3ee1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9161b78f8ec3ee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891022.089780:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:3.0:1788891022.089786:0:13247:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788891022.089810:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788891022.089822:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9da1f52c8380 x1875787996276096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788891035 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891022.089842:0:13247:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788891022.089848:0:13247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788891022.089854:0:13247:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788891022.089860:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788891022.089864:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9da1f52c8380 x1875787996276096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788891035 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891022.089872:0:13247:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788891022.089875:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1788891022.089885:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1875787996276096:0@lo:38:kworker.0 00010000:00010000:3.0:1788891022.090932:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.090944:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.090965:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.090971:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.091146:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891022.091156:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.091164:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.091201:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.091207:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.091493:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891022.091509:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.091518:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030200 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:1.0:1788891022.091522:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.091530:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891022.091537:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891022.091555:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788891022.091558:0:6678:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788891022.091580:0:6678:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9da1ca804000 00010000:00010000:1.0:1788891022.091584:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.091592:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c0030200/0x9161b78f8ec3ee2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9161b78f8ec3ee32 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.091605:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891022.091608:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.091622:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87e00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:1.0:1788891022.091625:0:6678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.091632:0:6678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891022.091638:0:6678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891022.091643:0:6678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788891022.091644:0:6678:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788891022.091648:0:6678:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9da1ca804000 00010000:00010000:1.0:1788891022.091651:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891022.091669:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891022.091670:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891022.091672:0:6678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891022.091747:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891022.091753:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87e00/0x9161b78f8ec3f069 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9161b78f8ec3f070 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891022.091768:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788891022.091775:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788891022.091775:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788891022.091779:0:13247:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788891022.091801:0:13247:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788891022.091806:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788891022.091811:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891022.091823:0:13247:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788891022.091827:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9da1c5264d28) has no exports 00000020:00080000:3.0:1788891022.091850:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9da1c5264d28) has no exports 00000020:01000000:2.0:1788891022.094018:0:13247:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9da1ffa6a8a0 - data ffff9da1f8c21e58/ffff9da1d0689800 00000020:01000000:2.0:1788891022.094163:0:13247:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9da1f9bb64e0 - data ffff9da1f042ce58/ffff9da1f4ceb000 00100000:10000000:2.0:1788891022.105883:0:13247:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788891022.128251:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ed21 00000020:00000080:3.0:1788891022.128260:0:13247:0:(genops.c:885:class_export_put()) final put ffff9da1fb998800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788891022.128283:0:13247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9da1c5240800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788891022.128287:0:13247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1c5240800 2 00000020:01000004:3.0:1788891022.128290:0:13247:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9da1c5240800 from lustre-OST0001 00000020:00000080:3.0:1788891022.128322:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891022.128332:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788891022.128335:0:13247:0:(genops.c:885:class_export_put()) final put ffff9da1f4c1f800/lustre-OST0001_UUID 00000020:00000080:3.0:1788891022.128337:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f4c1f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788891022.128344:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1788891022.128348:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fb998800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788891022.128430:0:13247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 68b804f9-71ae-42dc-a11e-677332e27dfa->MGS 00010000:00010000:3.0:1788891022.128445:0:13247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da202179a00/0x9161b78f8ec3ec25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3ec2c expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788891022.128457:0:13247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da202179a00/0x9161b78f8ec3ec25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3ec2c expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891022.128463:0:13247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788891022.128465:0:13247:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788891022.128468:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788891022.128487:0:13247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9da1ca804000 00010000:00010000:3.0:1788891022.128491:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da202179a00/0x9161b78f8ec3ec25 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9161b78f8ec3ec2c expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891022.128505:0:13247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9161b78f8ec3ee78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788891022.128512:0:13247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9161b78f8ec3ee78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891022.128531:0:13247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788891022.128533:0:13247:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788891022.128535:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788891022.128543:0:13247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9da1ca804000 00010000:00010000:3.0:1788891022.128547:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c29efe00/0x9161b78f8ec3ee71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9161b78f8ec3ee78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788891022.128563:0:13247:0:(import.c:65:import_set_state_nolock()) ffff9da1ca804000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788891022.128566:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788891022.128569:0:13247:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788891022.128571:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788891022.128574:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788891022.128584:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9da1f52c0380 x1875787996275968/t0(0) o250->MGC192.168.204.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788891030 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788891022.128603:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788891022.128606:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:1.0:1788891022.130002:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68b804f9-71ae-42dc-a11e-677332e27dfa:3278:1875787996275968:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:3.0:1788891022.130201:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788891022.130220:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3eb22 00000020:00000080:3.0:1788891022.130227:0:13247:0:(genops.c:885:class_export_put()) final put ffff9da1ca806800/68b804f9-71ae-42dc-a11e-677332e27dfa 00000020:01000000:3.0:1788891022.130242:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.118@tcp (flags='') 00000020:00000080:3.0:1788891022.130249:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788891022.130253:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1ca806800/68b804f9-71ae-42dc-a11e-677332e27dfa for MGC192.168.204.118@tcp 00000020:00000080:3.0:1788891022.130257:0:13247:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.118@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788891022.130262:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9da1f024b370) has no exports 10000000:01000000:1.0:1788891022.130303:0:5812:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788891022.130476:0:13247:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.118@tcp: client import never connected 00000100:00080000:3.0:1788891022.130480:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788891022.130482:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788891022.130485:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788891022.130487:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788891022.130531:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788891022.130543:0:485:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1ca804000 for MGC192.168.204.118@tcp 00000020:00000080:3.0:1788891022.130544:0:13247:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.118@tcp (uuid 68b804f9-71ae-42dc-a11e-677332e27dfa) 00000020:01000000:3.0:1788891022.130553:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788891022.130554:0:485:0:(genops.c:885:class_export_put()) final put ffff9da1ca806000/68b804f9-71ae-42dc-a11e-677332e27dfa 00000020:00000080:0.0:1788891022.130558:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1ca806000/68b804f9-71ae-42dc-a11e-677332e27dfa for MGC192.168.204.118@tcp 00000020:01000000:0.0:1788891022.130562:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.118@tcp (68b804f9-71ae-42dc-a11e-677332e27dfa) 00000020:00000080:3.0:1788891022.130569:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891022.130574:0:13247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788891022.130579:0:13247:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9da1f9bc1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788891022.130586:0:13247:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9da1cae5cd28) has exports, disconnecting them 00000020:00080000:3.0:1788891022.130591:0:13247:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9da1f9bc1000), last request at 1788890873 00000020:00000080:3.0:1788891022.130595:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ed4b 00000020:00080000:3.0:1788891022.130606:0:13247:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9da1f9bc1000): rc 0 00000020:00000080:3.0:1788891022.130610:0:13247:0:(genops.c:885:class_export_put()) final put ffff9da1f9bc1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788891022.130867:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f9bc1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788891022.137259:0:13247:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788891022.137269:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788891022.137274:0:13247:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788891022.137282:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788891022.137381:0:5802:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788891022.138772:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9da1f9bc2800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788891022.138799:0:6678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788891022.138939:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788891022.139784:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9da1c912b400:5798] 1 exiting: rc = 0 00000100:00100000:3.0:1788891022.140895:0:5845:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9da1fb916e00:5845] 2 exiting: rc = 0 00000100:00100000:3.0:1788891022.151273:0:5797:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9da1d1851c00:5797] 0 exiting: rc = 1 00000100:00100000:2.0:1788891022.152538:0:6677:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff9da1ffc31400:6677] 3 exiting: rc = 0 00000100:00100000:0.0:1788891022.152680:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.153012:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9da1c912aa00:5799] 0 exiting: rc = 1 00000100:00100000:3.0:1788891022.153033:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9da1c912a200:5800] 1 exiting: rc = 0 00000100:00100000:3.0:1788891022.153088:0:6679:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9da1c9bf9000:6679] 3 exiting: rc = 0 00000100:00100000:1.0:1788891022.153199:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9da1c912b200:5801] 2 exiting: rc = 0 00000100:00100000:0.0:1788891022.153218:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153225:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153232:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153238:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153243:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153253:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153259:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153266:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153271:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153277:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153282:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153288:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153294:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153299:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153305:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153311:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153317:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153323:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153327:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153332:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153337:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153342:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153347:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153351:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153356:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153360:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153368:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153373:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153377:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153381:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153385:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153389:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153394:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153398:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153402:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153413:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153418:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153423:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153427:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153431:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153435:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153440:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153444:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153448:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153452:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153455:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153459:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153463:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153467:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153471:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153475:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153479:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153483:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153487:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153492:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153496:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153500:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153503:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153507:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153511:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153515:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153519:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153522:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.153526:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788891022.154382:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788891022.154393:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788891022.154398:0:13247:0:(genops.c:885:class_export_put()) final put ffff9da1f9bc1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788891022.154402:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f9bc1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788891022.154407:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788891022.154448:0:13247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1c5240800 1 00000020:00000080:3.0:1788891022.154454:0:13247:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9161b78f8ec3ecf0 00000020:00000080:3.0:1788891022.154461:0:13247:0:(genops.c:885:class_export_put()) final put ffff9da1f5304800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788891022.154482:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788891022.154486:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788891022.154491:0:13247:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788891022.154495:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9da201c63370) has no exports 00000020:00000080:1.0:1788891022.154571:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1f5304800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788891022.168542:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891022.168558:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788891022.168564:0:13247:0:(genops.c:885:class_export_put()) final put ffff9da2016a9000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788891022.168568:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff9da2016a9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788891022.168574:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788891022.168753:0:13247:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9da2016a9800 00000020:01000000:2.0:1788891022.168775:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788891022.168786:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788891022.168790:0:13247:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788891022.168794:0:13247:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9da1fa418000) has no exports 00000020:00000080:2.0:1788891022.168816:0:13247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788891022.168821:0:13247:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788891022.168824:0:13247:0:(genops.c:885:class_export_put()) final put ffff9da1fa410000/OSS_uuid 00000020:00000080:2.0:1788891022.168826:0:13247:0:(genops.c:844:class_export_destroy()) destroying export ffff9da1fa410000/OSS_uuid for OSS 00000020:01000000:2.0:1788891022.168829:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788891022.168888:0:11963:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9da1f4cdcc00:11963] 3 exiting: rc = 0 00000100:00100000:2.0:1788891022.169189:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9da201b4bc00:6664] 2 exiting: rc = 0 00000100:00080000:1.0:1788891022.169969:0:5811:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788891022.170084:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9da1c4149c00:6663] 1 exiting: rc = 0 00000100:00100000:1.0:1788891022.170160:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9da1f0022800:6662] 0 exiting: rc = 1 00000100:00100000:2.0:1788891022.170238:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170248:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170254:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170265:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170274:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170283:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170293:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170301:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170309:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170315:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170321:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170326:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170332:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170337:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170342:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170347:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170352:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170357:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170363:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170369:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170373:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170380:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170385:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170390:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170396:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170412:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170417:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170422:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170428:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170434:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170440:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170445:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170451:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170456:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170461:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170466:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170471:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170476:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170482:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170488:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170493:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170498:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170504:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170509:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170515:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170520:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170525:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170530:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170535:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170540:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170546:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170551:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170556:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170561:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170566:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170571:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170577:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170583:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170588:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170593:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170608:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170625:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170631:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.170636:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171552:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9da1d0625800:6665] 0 exiting: rc = 1 00000100:00100000:1.0:1788891022.171671:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9da201b4b800:6666] 1 exiting: rc = 0 00000100:00100000:2.0:1788891022.171759:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171767:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171774:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171781:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171788:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171794:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171800:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171804:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171809:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171814:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171819:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171823:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171828:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171833:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171838:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171843:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171848:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171853:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171858:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171864:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171868:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171874:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171879:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171884:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171888:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171894:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171900:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171905:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171910:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171915:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171930:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171935:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171941:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171946:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171952:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171960:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171965:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171970:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171976:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171982:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171987:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.171994:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172000:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172006:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172013:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172019:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172032:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172040:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172046:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172052:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172057:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172063:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172071:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172077:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172083:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172089:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172094:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172099:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172106:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172111:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172116:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172120:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172126:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.172131:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788891022.173238:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9da1f011a000:6669] 2 exiting: rc = 0 00000100:00100000:3.0:1788891022.173457:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9da1f011b600:6667] 0 exiting: rc = 1 00000100:00100000:2.0:1788891022.174361:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9da1f011a200:6668] 1 exiting: rc = 0 00000100:00100000:3.0:1788891022.174543:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174550:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174555:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174561:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174566:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174577:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174583:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174588:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174594:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174600:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174605:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174609:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174626:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174632:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174644:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174650:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174656:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174661:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174666:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174672:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174677:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174682:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174688:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174694:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174699:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174704:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174709:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174714:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174719:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174724:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174730:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174735:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174743:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174749:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174755:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174761:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174766:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174773:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174790:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174796:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174807:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174812:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174817:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174823:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174828:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174833:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174839:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174844:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174915:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174920:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174925:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174931:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174936:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174941:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174947:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174953:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174961:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174966:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174972:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174977:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174983:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174989:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.174995:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.175010:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788891022.179536:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9da1c533ee00:6670] 0 exiting: rc = 1 00000100:00100000:2.0:1788891022.179644:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9da1c533f800:6671] 1 exiting: rc = 0 00000100:00100000:0.0:1788891022.179755:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179763:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179769:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179775:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179780:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179785:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179808:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179813:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179818:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179824:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179829:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179834:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179839:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179844:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179912:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179918:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179924:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179929:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179934:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179943:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179948:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179953:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179958:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179963:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179968:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179977:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179983:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179988:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179993:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.179997:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180002:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180007:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180011:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180016:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180021:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180026:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180030:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180035:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180040:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180044:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180049:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180062:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180067:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180073:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180078:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180084:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180092:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180098:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180104:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180109:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180115:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180121:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180125:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180130:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180135:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180140:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180145:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180150:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180155:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180160:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180255:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180262:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180267:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.180272:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788891022.181097:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9da1c533e200:6672] 0 exiting: rc = 1 00000100:00100000:1.0:1788891022.181936:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9da1f6d19000:6673] 1 exiting: rc = 0 00000100:00100000:0.0:1788891022.182081:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182090:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182105:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182120:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182128:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182137:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182142:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182200:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182214:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182221:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182226:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182233:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182252:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182258:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182264:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182270:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182275:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182281:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182287:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182308:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182319:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182326:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182332:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182338:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182345:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182351:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182358:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182366:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182372:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182378:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182385:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182407:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182414:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182422:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182429:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182437:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182444:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182450:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182456:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182463:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182470:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182477:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182483:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182504:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182512:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182519:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182526:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182539:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182546:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182552:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182558:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182564:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182570:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182579:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182585:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182607:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182626:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182633:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182640:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182645:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182662:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182670:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182679:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788891022.182686:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788891022.190719:0:13247:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788891032.776807:0:13855:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788891038.196272:0:14318:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788891038.196277:0:14318:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788891038.196397:0:14318:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9da0c1acc000 00000020:01000004:0.0:1788891038.196413:0:14318:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788891038.196421:0:14318:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788891038.196434:0:14318:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9da1fb8c4d28) 00000020:00000080:0.0:1788891038.196447:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788891038.218047:0:14318:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788891038.222380:0:14318:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788891038.223245:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788891038.223444:0:14318:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788891038.223577:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1788891038.223722:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788891038.223877:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1788891038.224042:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1788891038.224141:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788891038.224446:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1788891038.229159:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 590: rc = 0 00100000:10000000:1.0:1788891038.229377:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 590: rc = 0 00100000:10000000:1.0:1788891038.229859:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 774: rc = 0 00100000:10000000:1.0:1788891038.230099:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 774: rc = 0 00100000:10000000:1.0:1788891038.230385:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 774: rc = 0 00100000:10000000:1.0:1788891038.230630:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 774: rc = 0 00100000:10000000:1.0:1788891038.232013:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 774: rc = 0 00100000:10000000:1.0:1788891038.232353:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 774: rc = 0 00100000:10000000:1.0:1788891038.232603:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 774: rc = 0 00100000:10000000:1.0:1788891038.233129:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 774: rc = 0 00100000:10000000:1.0:1788891038.233441:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:1.0:1788891038.233686:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:1.0:1788891038.233913:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 774: rc = 0 00100000:10000000:1.0:1788891038.234143:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 774: rc = 0 00100000:10000000:1.0:1788891038.234575:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 285: rc = 0 00100000:10000000:1.0:1788891038.234802:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 285: rc = 0 00100000:10000000:1.0:1788891038.235036:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 285: rc = 0 00100000:10000000:1.0:1788891038.235374:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 285: rc = 0 00100000:10000000:1.0:1788891038.235635:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 285: rc = 0 00100000:10000000:1.0:1788891038.235865:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 285: rc = 0 00100000:10000000:1.0:1788891038.236099:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 285: rc = 0 00100000:10000000:1.0:1788891038.236427:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 285: rc = 0 00100000:10000000:1.0:1788891038.236679:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 285: rc = 0 00100000:10000000:1.0:1788891038.236908:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 285: rc = 0 00100000:10000000:1.0:1788891038.237143:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 285: rc = 0 00100000:10000000:1.0:1788891038.237879:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 285: rc = 0 00100000:10000000:1.0:1788891038.238503:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 285: rc = 0 00100000:10000000:1.0:1788891038.238914:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 285: rc = 0 00100000:10000000:1.0:1788891038.239513:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 285: rc = 0 00100000:10000000:1.0:1788891038.239761:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 285: rc = 0 00100000:10000000:1.0:1788891038.240021:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 285: rc = 0 00100000:10000000:1.0:1788891038.240323:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 285: rc = 0 00100000:10000000:1.0:1788891038.240582:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 285: rc = 0 00100000:10000000:1.0:1788891038.240816:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 285: rc = 0 00100000:10000000:1.0:1788891038.241048:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 285: rc = 0 00100000:10000000:1.0:1788891038.241386:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 285: rc = 0 00100000:10000000:1.0:1788891038.241617:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 285: rc = 0 00100000:10000000:1.0:1788891038.241856:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 285: rc = 0 00100000:10000000:1.0:1788891038.242100:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 285: rc = 0 00100000:10000000:1.0:1788891038.242373:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 285: rc = 0 00100000:10000000:1.0:1788891038.242602:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 285: rc = 0 00100000:10000000:1.0:1788891038.242823:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 285: rc = 0 00100000:10000000:1.0:1788891038.243059:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 285: rc = 0 00100000:10000000:1.0:1788891038.243346:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 285: rc = 0 00100000:10000000:1.0:1788891038.243586:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 285: rc = 0 00100000:10000000:1.0:1788891038.243828:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 285: rc = 0 00100000:10000000:1.0:1788891038.244606:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 274: rc = 0 00100000:10000000:1.0:1788891038.245109:0:14318:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788891038.245377:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:1.0:1788891038.245563:0:14318:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788891038.245633:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:1.0:1788891038.245801:0:14318:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788891038.245862:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:1.0:1788891038.246308:0:14318:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788891038.246381:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 591: rc = 0 00100000:10000000:1.0:1788891038.246558:0:14318:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788891038.246620:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 591: rc = 0 00100000:10000000:1.0:1788891038.246800:0:14318:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788891038.246867:0:14318:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 591: rc = 0 00000020:00000080:1.0:1788891038.247136:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788891038.247146:0:14318:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788891038.247157:0:14318:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3fe15 00000020:01000004:1.0:1788891038.247190:0:14318:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788891038.247201:0:14318:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788891038.247206:0:14318:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9da0c1acc000 from MGS 00000020:01000004:1.0:1788891038.247210:0:14318:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788891038.247220:0:14318:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9da1c5263370) 00000020:00000080:1.0:1788891038.247230:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788891038.247286:0:14318:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da0c1acc000 from MGS, refs=2 00080000:01000000:1.0:1788891038.247292:0:14318:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788891038.247308:0:14318:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3fe23 00000100:00100000:1.0:1788891038.247400:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788891038.247518:0:14318:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788891038.247526:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788891038.248591:0:14318:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788891038.248609:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788891038.250392:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788891038.250577:0:14318:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788891038.250583:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788891038.251413:0:14318:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788891038.251421:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788891038.252151:0:14318:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788891038.252159:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788891038.253021:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891038.253025:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891038.253027:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891038.253526:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891038.253529:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891038.253530:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891038.254069:0:14318:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788891038.256239:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788891038.261633:0:14318:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788891038.261649:0:14318:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788891038.261651:0:14318:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788891038.268070:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788891038.268379:0:14318:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788891038.268508:0:14318:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788891038.269007:0:14318:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788891038.270111:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788891038.270328:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788891038.270334:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788891038.270970:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788891038.270977:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788891038.271258:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788891038.271265:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788891038.272435:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788891038.272457:0:14318:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.118@tcp' 00000020:01000004:0.0:1788891038.272459:0:14318:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788891038.272489:0:14318:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.118@tcp (typ=mgc) 00000020:00000080:0.0:1788891038.272502:0:14318:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.118@tcp (ffff9da1fb8c3370) 00000020:00000080:0.0:1788891038.272516:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788891038.272591:0:14318:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da0c1ac9800@MGC192.168.204.118@tcp: add connection 192.168.204.118@tcp at head 00010000:00010000:0.0:1788891038.272733:0:14318:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.118@tcp-0 is initialized 00000040:01000000:0.0:1788891038.272739:0:14318:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.118@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788891038.272890:0:14332:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788891038.274370:0:14333:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788891038.274461:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.118@tcp (uuid 73a29ebe-4d40-4a82-b77a-4b1222504c0e) 00000020:00000080:1.0:1788891038.274483:0:14318:0:(genops.c:1385:class_connect()) connect: client 73a29ebe-4d40-4a82-b77a-4b1222504c0e, cookie 0x9161b78f8ec3fe31 00000100:00080000:1.0:1788891038.274496:0:14318:0:(import.c:510:import_select_connection()) MGC192.168.204.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788891038.274501:0:14318:0:(import.c:624:import_select_connection()) MGC192.168.204.118@tcp: import ffff9da0c1ac9800 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:1.0:1788891038.274532:0:14318:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f52c8380 x1875787996276224/t0(0) o250->MGC192.168.204.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891038.274560:0:14318:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 73a29ebe-4d40-4a82-b77a-4b1222504c0e->MGS 00000020:01000004:1.0:1788891038.274577:0:14318:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788891038.274587:0:14318:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788891038.274599:0:14318:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9da1c5260000) 00000020:00000080:1.0:1788891038.274610:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788891038.277390:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3278:1875787996276224:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788891038.277469:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891038.277597:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996276224 00000100:00100000:3.0:1788891038.277605:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996276224 00000100:00100000:3.0:1788891038.277632:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891038.277638:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3278:x1875787996276224:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788891038.277672:0:14329:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 73a29ebe-4d40-4a82-b77a-4b1222504c0e@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1788891038.277704:0:14329:0:(genops.c:1385:class_connect()) connect: client 73a29ebe-4d40-4a82-b77a-4b1222504c0e, cookie 0x9161b78f8ec3fe3f 00000100:00080000:3.0:1788891038.277832:0:14329:0:(import.c:65:import_set_state_nolock()) ffff9da1d1804000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891038.277883:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+5:3278:x1875787996276224:12345-0@lo:250:mount.lustre.0 Request processed in 243us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891038.277891:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891038.277935:0:3278:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788891038.277943:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) MGC192.168.204.118@tcp: connect to target with instance 0 00000100:00080000:3.0:1788891038.277952:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) MGC192.168.204.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788891038.277956:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788891038.277959:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da0c1ac9800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788891038.277961:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788891038.277981:0:3278:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788891038.277986:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3278:1875787996276224:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788891038.283414:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788891038.287117:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788891038.287125:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788891038.288433:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788891038.288443:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788891038.289477:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788891038.289486:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788891038.290434:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788891038.290608:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788891038.290613:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788891038.291085:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788891038.291092:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788891038.318749:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891038.318995:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788891038.319002:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788891038.320163:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788891038.320328:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788891038.320803:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891038.320980:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788891038.320985:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788891038.321443:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788891038.321450:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788891038.321906:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891038.322065:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788891038.322071:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788891038.322525:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788891038.322531:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788891038.323080:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788891038.323441:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788891038.323447:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788891038.323818:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788891038.323824:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788891038.336561:0:14318:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788891038.336774:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788891038.336781:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788891038.338070:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788891038.338080:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788891038.340897:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788891038.340908:0:14318:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788891038.342696:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788891038.342723:0:14318:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788891038.342729:0:14318:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788891038.342916:0:14318:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788891038.342951:0:14318:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.118@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788891038.342955:0:14318:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788891038.342957:0:14318:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891038.342958:0:14318:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891038.342959:0:14318:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891038.342960:0:14318:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891038.342962:0:14318:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891038.342963:0:14318:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891038.342965:0:14318:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891038.342967:0:14318:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891038.342968:0:14318:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788891038.342970:0:14318:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788891038.342973:0:14318:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788891038.342974:0:14318:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891038.342975:0:14318:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891038.342976:0:14318:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891038.342977:0:14318:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891038.342978:0:14318:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891038.342979:0:14318:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891038.342980:0:14318:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891038.342981:0:14318:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891038.342982:0:14318:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788891038.343017:0:14318:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788891038.343039:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276352:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788891038.343113:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891038.343194:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996276352 00000100:00100000:1.0:1788891038.343202:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996276352 00000100:00100000:1.0:1788891038.343240:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891038.343249:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+5:14318:x1875787996276352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788891038.343293:0:14331:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788891038.343311:0:14331:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788891038.343314:0:14331:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:0.0:1788891038.343324:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f53779c0 going to sleep for 11 seconds 10000000:01000000:0.0:1788891038.343884:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788891038.344224:0:14331:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788891038.345315:0:14353:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788891038.345322:0:14353:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788891038.345324:0:14353:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788891038.345358:0:14353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788891038.345729:0:14331:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788891038.345739:0:14331:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788891038.355400:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+5:14318:x1875787996276352:12345-0@lo:253:mount.lustre.0 Request processed in 12140us (12276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.355419:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891038.355531:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276352:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788891038.355547:0:14318:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788891038.355551:0:14318:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788891038.355552:0:14318:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788891038.355554:0:14318:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788891038.355555:0:14318:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788891038.355556:0:14318:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788891038.355558:0:14318:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788891038.355572:0:14318:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788891038.355573:0:14318:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788891038.355575:0:14318:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788891038.355576:0:14318:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788891038.355597:0:14318:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9da0c1acc000 from lustre-MDT0000 10000000:01000000:2.0:1788891038.355626:0:14318:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788891038.355629:0:14318:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788891038.355633:0:14318:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9da1fb8c3370 10000000:01000000:2.0:1788891038.355638:0:14318:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788891038.355645:0:14318:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9da1fb8c3370 from 1 10000000:01000000:2.0:1788891038.355647:0:14318:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788891038.355694:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.355705:0:14318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.355715:0:14318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.355736:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891038.355773:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.355812:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891038.355867:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996276480 00000100:00100000:3.0:1788891038.355874:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996276480 00000100:00100000:3.0:1788891038.355916:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788891038.355926:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+5:14318:x1875787996276480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891038.355939:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891038.355952:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1f4edc000/0x9161b78f8ec3fe4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3fe46 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.355972:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1f4edc000/0x9161b78f8ec3fe4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3fe46 expref: 6 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.355993:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1f4edc000/0x9161b78f8ec3fe4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3fe46 expref: 6 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.356001:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc000, rc 0) 00000100:00100000:3.0:1788891038.356038:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+6:14318:x1875787996276480:12345-0@lo:101:mount.lustre.0 Request processed in 113us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891038.356045:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891038.356149:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891038.356162:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.356203:0:14318:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.356244:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891038.356276:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.356288:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.356352:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996276608 00000100:00100000:0.0:1788891038.356363:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996276608 00000100:00100000:0.0:1788891038.356390:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788891038.356397:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+6:14318:x1875787996276608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891038.356614:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+6:14318:x1875787996276608:12345-0@lo:501:mount.lustre.0 Request processed in 217us (336us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788891038.356621:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891038.356896:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276608:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788891038.356918:0:14318:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788891038.357008:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.357017:0:14318:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891038.357025:0:14318:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9da0c1acc000 10000000:01000000:2.0:1788891038.357029:0:14318:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788891038.357033:0:14318:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9da0c1acc000 10000000:01000000:2.0:1788891038.357036:0:14318:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788891038.357039:0:14318:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9da0c1acc000 from 1 10000000:01000000:2.0:1788891038.357042:0:14318:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788891038.357060:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87600/0x9161b78f8ec3fe54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.357067:0:14318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87600/0x9161b78f8ec3fe54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.357075:0:14318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87600/0x9161b78f8ec3fe54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.357088:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891038.357117:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.357145:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.357197:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996276736 00000100:00100000:0.0:1788891038.357202:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996276736 00000100:00100000:0.0:1788891038.357234:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891038.357241:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+6:14318:x1875787996276736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891038.357249:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891038.357260:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da201cb9a00/0x9161b78f8ec3fe5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3fe54 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.357274:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da201cb9a00/0x9161b78f8ec3fe5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3fe54 expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.357283:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da201cb9a00/0x9161b78f8ec3fe5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3fe54 expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.357291:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9a00, rc 0) 00000100:00100000:0.0:1788891038.357338:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+7:14318:x1875787996276736:12345-0@lo:101:mount.lustre.0 Request processed in 97us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.357344:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788891038.357417:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891038.357436:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87600/0x9161b78f8ec3fe54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe5b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.357443:0:14318:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87600/0x9161b78f8ec3fe54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3fe5b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891038.357454:0:14318:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788891038.358462:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87600/0x9161b78f8ec3fe54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe5b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.358473:0:14318:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87600/0x9161b78f8ec3fe54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe5b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891038.358479:0:14318:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788891038.358484:0:14318:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788891038.358489:0:14318:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9da0c1acc000 10000000:01000000:2.0:1788891038.358491:0:14318:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788891038.358494:0:14318:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788891038.358496:0:14318:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788891038.358518:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87c00/0x9161b78f8ec3fe62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.358525:0:14318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87c00/0x9161b78f8ec3fe62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.358533:0:14318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87c00/0x9161b78f8ec3fe62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.358549:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891038.358598:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891038.358759:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996276864 00000100:00100000:0.0:1788891038.358766:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996276864 00000100:00100000:0.0:1788891038.358797:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891038.358806:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+7:14318:x1875787996276864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891038.358826:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891038.358837:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da201cb8e00/0x9161b78f8ec3fe69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3fe62 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.358853:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da201cb8e00/0x9161b78f8ec3fe69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3fe62 expref: 8 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.358862:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da201cb8e00/0x9161b78f8ec3fe69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3fe62 expref: 8 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.358870:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8e00, rc 0) 00000100:00100000:0.0:1788891038.358898:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+8:14318:x1875787996276864:12345-0@lo:101:mount.lustre.0 Request processed in 93us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.358904:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788891038.358995:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891038.359013:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891038.359023:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87c00/0x9161b78f8ec3fe62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe69 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.359031:0:14318:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87c00/0x9161b78f8ec3fe62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3fe69 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.359075:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891038.359098:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.359120:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.359198:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996276992 00000100:00100000:0.0:1788891038.359203:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996276992 00000100:00100000:0.0:1788891038.359227:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788891038.359233:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+8:14318:x1875787996276992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891038.359605:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+9:14318:x1875787996276992:12345-0@lo:501:mount.lustre.0 Request processed in 371us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.359612:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788891038.359845:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996276992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891038.359872:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996277120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891038.359905:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.359930:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.359982:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996277120 00000100:00100000:0.0:1788891038.359987:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996277120 00000100:00100000:0.0:1788891038.360014:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891038.360021:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+9:14318:x1875787996277120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891038.360339:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+9:14318:x1875787996277120:12345-0@lo:503:mount.lustre.0 Request processed in 317us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.360356:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891038.360487:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996277120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891038.361022:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14354:1875787996277248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788891038.361062:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.361126:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f00e90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.361165:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996277248 00000100:00100000:0.0:1788891038.361273:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996277248 00000100:00100000:0.0:1788891038.361350:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891038.361359:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+9:14354:x1875787996277248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891038.361599:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+9:14354:x1875787996277248:12345-0@lo:502:llog_process_th.0 Request processed in 241us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.361606:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891038.361690:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14354:1875787996277248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788891038.361715:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891038.361727:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.361730:0:14354:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788891038.361736:0:14354:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788891038.361739:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788891038.361753:0:14354:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9da1cae5cd28) 00000020:00000080:3.0:1788891038.361771:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788891038.361777:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788891038.361838:0:14354:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788891038.361844:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3fe77 00000020:00000080:3.0:1788891038.362047:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788891038.362051:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891038.362054:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.362056:0:14354:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788891038.362058:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891038.362061:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.362063:0:14354:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788891038.362065:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788891038.362072:0:14354:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9da1cae58000) 00000020:00000080:3.0:1788891038.362080:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788891038.362084:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788891038.362091:0:14354:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788891038.362094:0:14354:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788891038.362099:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788891038.362148:0:14354:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da0c1acc000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788891038.362162:0:14354:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9da1cae599b8) 00000020:00000080:3.0:1788891038.362194:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788891038.362234:0:14354:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788891038.362241:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec3fe8c 00000020:00000080:3.0:1788891038.362339:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788891038.362345:0:14354:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788891038.362349:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9161b78f8ec3fe93 00080000:01000000:3.0:1788891038.362354:0:14354:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788891038.362357:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3fe9a 00010000:00010000:3.0:1788891038.424425:0:14354:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788891038.425130:0:14354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788891038.425353:0:14354:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788891038.425837:0:14354:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9da1cae5b370) 00000020:00000080:3.0:1788891038.425854:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788891038.425924:0:14354:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788891038.425932:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3fea8 00000020:00000080:2.0:1788891038.426770:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788891038.432517:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9161b78f8ec3feaf 00000020:00000080:3.0:1788891038.432933:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788891038.432945:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891038.432951:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.432953:0:14354:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788891038.432958:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891038.432963:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.432965:0:14354:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788891038.432971:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788891038.433007:0:14354:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788891038.433024:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891038.433028:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.433030:0:14354:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788891038.433040:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788891038.433042:0:14354:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1788891038.433045:0:14354:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891038.433046:0:14354:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891038.433048:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788891038.433051:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.433052:0:14354:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788891038.433054:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788891038.433057:0:14354:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788891038.433062:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.433063:0:14354:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788891038.433066:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788891038.433071:0:14354:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.118@tcp to nid 0x20000c0a8cc76 (192.168.204.118@tcp) 00000020:01000000:3.0:1788891038.433098:0:14354:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788891038.433101:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788891038.433117:0:14354:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9da1f024b370) 00000020:00000080:3.0:1788891038.433130:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788891038.433135:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788891038.433221:0:14354:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788891038.433226:0:14354:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788891038.433232:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3febd 00010000:00080000:3.0:1788891038.433264:0:14354:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da1cae35000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.118@tcp at head 00010000:00010000:3.0:1788891038.433473:0:14354:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788891038.435005:0:14354:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788891038.435062:0:14354:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788891038.436209:0:14354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891038.436271:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788891038.437231:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788891038.437737:0:14358:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788891038.437742:0:14358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788891038.438447:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891038.438460:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788891038.438489:0:14354:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788891038.438508:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec3fec4 00000100:00080000:3.0:1788891038.438519:0:14354:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891038.438544:0:14354:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9da1cae35000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788891038.438579:0:14354:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1cafa7480 x1875787996277376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891038.438605:0:14354:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788891038.438660:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891038.438664:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.438666:0:14354:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788891038.438669:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788891038.438672:0:14354:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788891038.438673:0:14354:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891038.438675:0:14354:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788891038.438676:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788891038.438678:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.438680:0:14354:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788891038.438682:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788891038.438686:0:14354:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788891038.438690:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.438692:0:14354:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788891038.438695:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788891038.438698:0:14354:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.118@tcp to nid 0x20000c0a8cc76 (192.168.204.118@tcp) 00000020:01000000:3.0:1788891038.438723:0:14354:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788891038.438726:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788891038.438738:0:14354:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9da1f0248000) 00000020:00000080:3.0:1788891038.438750:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788891038.438755:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788891038.438818:0:14354:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788891038.438824:0:14354:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788891038.438830:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9161b78f8ec3fed2 00010000:00080000:3.0:1788891038.438858:0:14354:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da1f0238000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.118@tcp at head 00010000:00010000:3.0:1788891038.439044:0:14354:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788891038.439236:0:14354:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788891038.439265:0:14354:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788891038.439757:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996277376:0@lo:8:llog_process_th.0 00000040:00080000:3.0:1788891038.439816:0:14354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000400:00000100:1.0:1788891038.439830:0:3278:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787996277376 offset 0 length 520: 4 00000040:00080000:3.0:1788891038.439903:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788891038.439975:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788891038.440462:0:14360:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788891038.440467:0:14360:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788891038.441799:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788891038.441811:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788891038.441841:0:14354:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788891038.441859:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec3fed9 00000100:00080000:3.0:1788891038.441867:0:14354:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891038.441873:0:14354:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9da1f0238000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788891038.441904:0:14354:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1cafa5500 x1875787996277504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788891038.441966:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996277504:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788891038.442011:0:3278:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875787996277504 offset 0 length 520: 4 00000100:00080000:3.0:1788891038.442063:0:14354:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788891038.442114:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891038.442119:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.442121:0:14354:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788891038.442123:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891038.442127:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.442128:0:14354:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788891038.442131:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788891038.442133:0:14354:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788891038.442136:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891038.442138:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.442140:0:14354:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788891038.442142:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891038.442144:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.442146:0:14354:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788891038.442149:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788891038.442200:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14354:1875787996277632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891038.442254:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891038.442273:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.442286:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996277632 00000100:00100000:0.0:1788891038.442305:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996277632 00000100:00100000:0.0:1788891038.442362:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788891038.442373:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+9:14354:x1875787996277632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891038.442636:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+9:14354:x1875787996277632:12345-0@lo:502:llog_process_th.0 Request processed in 264us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.442645:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788891038.442675:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14354:1875787996277632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788891038.442700:0:14354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891038.442704:0:14354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.442706:0:14354:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788891038.442709:0:14354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788891038.442861:0:14318:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788891038.442877:0:14318:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788891038.442896:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87c00/0x9161b78f8ec3fe62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe69 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.442912:0:14318:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87c00/0x9161b78f8ec3fe62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe69 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891038.442920:0:14318:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9da0c1acc000 from 1 10000000:01000000:2.0:1788891038.442923:0:14318:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788891038.442947:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.442955:0:14318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.442964:0:14318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.442977:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996277760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891038.443005:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.443033:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8bf3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.443125:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996277760 00000100:00100000:0.0:1788891038.443130:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996277760 00000100:00100000:0.0:1788891038.443160:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788891038.443193:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+9:14318:x1875787996277760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891038.443203:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891038.443216:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3fee0 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.443236:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3fee0 expref: 10 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.443253:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3fee0 expref: 10 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.443262:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb9e00, rc 0) 00000100:00100000:0.0:1788891038.443307:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+10:14318:x1875787996277760:12345-0@lo:101:mount.lustre.0 Request processed in 140us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.443314:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788891038.443442:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996277760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891038.443452:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.443458:0:14318:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.443907:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996277888:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788891038.443943:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.443973:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8bf3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.444089:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996277888 00000100:00100000:0.0:1788891038.444094:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996277888 00000100:00100000:0.0:1788891038.444134:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788891038.444142:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+10:14318:x1875787996277888:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788891038.444156:0:14330:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788891038.444163:0:14330:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788891038.444332:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+10:14318:x1875787996277888:12345-0@lo:256:mount.lustre.0 Request processed in 190us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.444339:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891038.444665:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996277888:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788891038.445369:0:14318:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788891038.445389:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.445399:0:14318:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891038.445407:0:14318:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da0c1acc000 from 1 10000000:01000000:2.0:1788891038.445409:0:14318:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788891038.445441:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.445450:0:14318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.445606:0:14318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.445621:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788891038.445653:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.445720:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8bf3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891038.445756:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996278016 00000100:00100000:3.0:1788891038.445762:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996278016 00000100:00100000:3.0:1788891038.445800:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788891038.445809:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+10:14318:x1875787996278016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891038.445820:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891038.445833:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3feee expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.445853:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3feee expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.445863:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3feee expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.445872:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edca00, rc 0) 00000100:00100000:3.0:1788891038.445947:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14318:x1875787996278016:12345-0@lo:101:mount.lustre.0 Request processed in 139us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891038.445953:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788891038.446006:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891038.446019:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.446027:0:14318:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.446094:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891038.446117:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.446139:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8bf3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891038.446632:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996278144 00000100:00100000:1.0:1788891038.446960:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996278144 00000100:00100000:1.0:1788891038.446998:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788891038.447005:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14318:x1875787996278144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891038.447405:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14318:x1875787996278144:12345-0@lo:501:mount.lustre.0 Request processed in 399us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891038.447413:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788891038.447433:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891038.447521:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891038.447561:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891038.447593:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8bf3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.447612:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996278272 00000100:00100000:0.0:1788891038.447616:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996278272 00000100:00100000:0.0:1788891038.447646:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788891038.447653:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14318:x1875787996278272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891038.447819:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14318:x1875787996278272:12345-0@lo:503:mount.lustre.0 Request processed in 166us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.447826:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788891038.447963:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891038.448373:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14362:1875787996278400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891038.448402:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891038.448425:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788891038.448435:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996278400 00000100:00100000:1.0:1788891038.448440:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996278400 00000100:00100000:1.0:1788891038.448479:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788891038.448487:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14362:x1875787996278400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788891038.448924:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14362:x1875787996278400:12345-0@lo:502:llog_process_th.0 Request processed in 437us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891038.448931:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788891038.449022:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14362:1875787996278400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788891038.449047:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891038.449055:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.449058:0:14362:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788891038.449064:0:14362:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da0c1acc000 00000020:00000080:3.0:1788891038.449066:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788891038.449075:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891038.449077:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.449078:0:14362:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788891038.449081:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891038.449083:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.449084:0:14362:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788891038.449087:0:14362:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da0c1acc000 00000020:00000080:3.0:1788891038.449089:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788891038.449147:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891038.449151:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.449153:0:14362:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788891038.449155:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891038.449157:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891038.449158:0:14362:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788891038.449161:0:14362:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9da0c1acc000 00000020:00000080:3.0:1788891038.449163:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788891038.449227:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14362:1875787996278528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788891038.449262:0:14362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891038.449289:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.449385:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996278528 00000100:00100000:0.0:1788891038.449391:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996278528 00000100:00100000:0.0:1788891038.449423:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788891038.449438:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14362:x1875787996278528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891038.449587:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14362:x1875787996278528:12345-0@lo:502:llog_process_th.0 Request processed in 149us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.449594:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788891038.449699:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14362:1875787996278528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788891038.449719:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788891038.449724:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891038.449725:0:14362:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788891038.449729:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788891038.449939:0:14318:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788891038.449968:0:14318:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788891038.450025:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.450035:0:14318:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891038.450077:0:14318:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788891038.450080:0:14318:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9da0c1acc000 10000000:01000000:0.0:1788891038.450083:0:14318:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9da0c1acc000 10000000:01000000:0.0:1788891038.450087:0:14318:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891038.450091:0:14318:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da0c1acc000 from 1 10000000:01000000:0.0:1788891038.450094:0:14318:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788891038.450116:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9400/0x9161b78f8ec3fefc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.450123:0:14318:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da201cb9400/0x9161b78f8ec3fefc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.450132:0:14318:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da201cb9400/0x9161b78f8ec3fefc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891038.450144:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891038.450206:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891038.450233:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c4158cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891038.450290:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996278656 00000100:00100000:1.0:1788891038.450305:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996278656 00000100:00100000:1.0:1788891038.450326:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788891038.450332:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14318:x1875787996278656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891038.450340:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891038.450351:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3ff03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3fefc expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.450372:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3ff03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3fefc expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.450391:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6f000/0x9161b78f8ec3ff03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3fefc expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.450400:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f000, rc 0) 00000100:00100000:1.0:1788891038.450432:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14318:x1875787996278656:12345-0@lo:101:mount.lustre.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891038.450438:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788891038.450531:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891038.450543:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da201cb9400/0x9161b78f8ec3fefc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff03 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.450552:0:14318:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da201cb9400/0x9161b78f8ec3fefc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ff03 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891038.450592:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891038.450619:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891038.450643:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c4158cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891038.450727:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996278784 00000100:00100000:1.0:1788891038.450731:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996278784 00000100:00100000:1.0:1788891038.450788:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788891038.450795:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14318:x1875787996278784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891038.451005:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14318:x1875787996278784:12345-0@lo:501:mount.lustre.0 Request processed in 210us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891038.451011:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788891038.451065:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891038.451091:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891038.451126:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891038.451139:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c4158cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.451149:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996278912 00000100:00100000:0.0:1788891038.451152:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996278912 00000100:00100000:0.0:1788891038.451192:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788891038.451199:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14318:x1875787996278912:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891038.451331:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14318:x1875787996278912:12345-0@lo:503:mount.lustre.0 Request processed in 132us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.451337:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788891038.451372:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996278912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891038.451968:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14363:1875787996279040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788891038.452005:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891038.452067:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c51aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891038.452096:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996279040 00000100:00100000:0.0:1788891038.452101:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996279040 00000100:00100000:0.0:1788891038.452163:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788891038.452194:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14363:x1875787996279040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788891038.452436:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14363:x1875787996279040:12345-0@lo:502:llog_process_th.0 Request processed in 243us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891038.452443:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788891038.452579:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14363:1875787996279040:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788891038.452631:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788891038.452645:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9da1f024cd28) 00000020:00000080:3.0:1788891038.452660:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788891038.452726:0:14363:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da0c1acc000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788891038.452734:0:14363:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9da0c1acc000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788891038.452737:0:14363:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da0c1acc000 4 00010000:00080000:3.0:1788891038.452765:0:14363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da1f023b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.118@tcp at head 00010000:00010000:3.0:1788891038.455384:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788891038.456847:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788891038.456882:0:14363:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788891038.456895:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9161b78f8ec3ff11 00000100:00080000:3.0:1788891038.456906:0:14363:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788891038.456911:0:14363:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9da1f023b800 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788891038.456952:0:14363:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1cafa6680 x1875787996279168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891038.456981:0:14363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788891038.457159:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996279168:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788891038.457319:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891038.458212:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996279168 00000100:00100000:3.0:1788891038.458221:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996279168 00000100:00100000:3.0:1788891038.458262:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891038.458270:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1875787996279168:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788891038.458351:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1875787996279168:12345-0@lo:38:llog_process_th.0 Request processed in 79us (1031us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788891038.458357:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891038.458448:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14363:1875787996279296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788891038.458588:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788891038.458596:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f023b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891038.458601:0:3278:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788891038.458604:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996279168:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788891038.459224:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891038.459242:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996279296 00000100:00100000:1.0:1788891038.459252:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996279296 00000100:00100000:3.0:1788891038.459256:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c435c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788891038.459287:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788891038.459308:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14363:x1875787996279296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788891038.459643:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14363:x1875787996279296:12345-0@lo:502:llog_process_th.0 Request processed in 348us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891038.459650:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788891038.459701:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14363:1875787996279296:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788891038.459726:0:14363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788891038.459792:0:14318:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788891038.459813:0:14318:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788891038.459833:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9400/0x9161b78f8ec3fefc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff03 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.459844:0:14318:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da201cb9400/0x9161b78f8ec3fefc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff03 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788891038.459893:0:14318:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788891038.459896:0:14318:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891038.459897:0:14318:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891038.459898:0:14318:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891038.459899:0:14318:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891038.459901:0:14318:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891038.459903:0:14318:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891038.459904:0:14318:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891038.459906:0:14318:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891038.459908:0:14318:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788891038.459912:0:14318:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788891038.459915:0:14318:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788891038.459916:0:14318:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891038.459917:0:14318:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891038.459918:0:14318:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891038.459919:0:14318:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891038.459921:0:14318:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891038.459922:0:14318:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891038.459924:0:14318:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891038.459925:0:14318:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891038.459926:0:14318:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788891038.459944:0:14318:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788891038.459962:0:14318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996279424:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788891038.459997:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891038.460024:0:14318:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891038.460622:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996279424 00000100:00100000:1.0:1788891038.460628:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996279424 00000100:00100000:1.0:1788891038.460728:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788891038.460737:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14318:x1875787996279424:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788891038.460758:0:14329:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788891038.460770:0:14329:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788891038.512241:0:14329:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788891038.512252:0:14329:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788891038.512402:0:14352:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788891038.512407:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788891038.512429:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.512447:0:14352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3fee0 expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.512456:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.512495:0:14352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3fee0 expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.512521:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3fee0 expref: 12 pid: 14331 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891038.512535:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14352:1875787996279552:0@lo:104: 00000100:00100000:0.0:1788891038.512600:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891038.512672:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c4158e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788891038.512683:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996279552 00000100:00100000:3.0:1788891038.512693:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996279552 00000100:00100000:3.0:1788891038.512743:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891038.512764:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:14352:x1875787996279552:12345-0@lo:104: 00010000:00010000:3.0:1788891038.512780:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891038.513058:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788891038.513065:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:14352:x1875787996279552:12345-0@lo:104: Request processed in 303us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891038.513074:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891038.513199:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14352:1875787996279552:0@lo:104: 00010000:00010000:0.0:1788891038.513220:0:14352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.513580:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891038.513587:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.513595:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86800 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788891038.513599:0:14325:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.513609:0:14325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891038.513616:0:14325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891038.513622:0:14325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788891038.513667:0:14325:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.513681:0:14325:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891038.513716:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891038.513723:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86800/0x9161b78f8ec3fee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3fee7 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891038.513745:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788891038.513757:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996279680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891038.513790:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788891038.513829:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891038.513832:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891038.513833:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891038.514096:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996279680 00000100:00100000:1.0:1788891038.514102:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996279680 00010000:00010000:1.0:1788891038.514123:0:14321:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3fee0 expref: 13 pid: 14331 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891038.514199:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788891038.514207:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+13:3281:x1875787996279680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891038.514218:0:14321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891038.514224:0:14321:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3fee0 expref: 13 pid: 14331 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514233:0:14321:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3fee0 expref: 13 pid: 14331 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514257:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da201cb9e00/0x9161b78f8ec3fee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3fee0 expref: 13 pid: 14331 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514280:0:14321:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514288:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788891038.514317:0:14321:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001910332s 00010000:00010000:1.0:1788891038.514321:0:14321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514328:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514334:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514341:0:14321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514346:0:14321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8000 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788891038.514351:0:14321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514358:0:14321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514376:0:14321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891038.514393:0:14321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891038.514433:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:3281:x1875787996279680:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891038.514439:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891038.514506:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996279680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788891038.514636:0:14352:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.514646:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891038.514669:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da201cb8000/0x9161b78f8ec3ff18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891038.519925:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14318:x1875787996279424:12345-0@lo:253:mount.lustre.0 Request processed in 59181us (59919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891038.519944:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788891038.520557:0:14318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14318:1875787996279424:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788891038.520574:0:14318:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788891038.520578:0:14318:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788891038.520580:0:14318:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788891038.520581:0:14318:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891038.520583:0:14318:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891038.520584:0:14318:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891038.520585:0:14318:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891038.520587:0:14318:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788891038.520588:0:14318:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788891038.520590:0:14318:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891038.520591:0:14318:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788891038.520605:0:14318:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788891038.529840:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788891038.530019:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788891038.531105:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788891038.531284:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788891038.532313:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788891038.532470:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788891038.533355:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788891038.533520:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788891038.533778:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788891038.533996:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788891038.534354:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788891038.534518:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788891038.569997:0:14318:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788891038.570578:0:14318:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788891038.570871:0:14376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788891038.570931:0:14376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788891038.572679:0:14318:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788891038.572808:0:14318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788891038.572861:0:14375:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788891038.572867:0:14375:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:0.0:1788891038.573799:0:14318:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788891038.573809:0:14318:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788891038.573955:0:14318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891038.575673:0:14318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788891038.576645:0:14318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788891038.576818:0:14318:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788891038.578647:0:14376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788891038.578724:0:14376:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788891038.578729:0:14376:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788891038.578828:0:14318:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1788891038.579988:0:14318:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788891038.584073:0:14318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788891038.611805:0:14318:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788891038.611840:0:14318:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd5081823988 00100000:10000000:1.0:1788891038.611848:0:14318:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788891038.612997:0:14318:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788891038.613016:0:14318:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788891038.613031:0:14318:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788891038.613048:0:14318:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788891039.286812:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788891039.478572:0:14371:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788891039.478580:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891039.478904:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1788891039.478911:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1788891039.670238:0:14333:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788891039.670247:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9da0c1acc000 from 6 10000000:01000000:3.0:1788891039.670252:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788891039.670309:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891039.670321:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891039.670331:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891039.670354:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996279808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788891039.670414:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891039.670482:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c937ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891039.670671:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996279808 00000100:00100000:1.0:1788891039.670679:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996279808 00000100:00100000:1.0:1788891039.670738:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788891039.670748:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14333:x1875787996279808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891039.670760:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891039.670774:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ff1f expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891039.670796:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff1f expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891039.670825:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff1f expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891039.670835:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f200, rc 0) 00000100:00100000:1.0:1788891039.670880:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14333:x1875787996279808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891039.670886:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788891039.671132:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996279808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891039.671157:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891039.671165:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891039.671238:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996279936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788891039.671280:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891039.671301:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c937ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891039.671352:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996279936 00000100:00100000:2.0:1788891039.671357:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996279936 00000100:00100000:2.0:1788891039.671381:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788891039.671386:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14333:x1875787996279936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788891039.671399:0:14329:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788891039.671415:0:14329:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788891039.671418:0:14329:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788891039.671510:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14333:x1875787996279936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891039.671517:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788891039.671729:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996279936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788891039.671765:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788891039.671771:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891039.671779:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891040.311555:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788891040.502484:0:14371:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788891040.502493:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788891040.502530:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1788891040.502538:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1788891041.299855:0:14618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788891041.338402:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891042.358544:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788891043.345654:0:14768:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeacc429d0 20000000:00000080:2.0:1788891043.345672:0:14768:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9da1f9e6a000 uarg=0000000000000000 20000000:01000000:2.0:1788891043.345706:0:14768:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788891043.345713:0:14768:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788891043.345718:0:14768:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788891043.346527:0:14769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788891043.346685:0:14768:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788891043.354344:0:14768:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788891043.354382:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.354402:0:14768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3feee expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.354411:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.354461:0:14768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3feee expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.354477:0:14768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3feee expref: 11 pid: 14329 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891043.354511:0:14768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14768:1875787996280064:0@lo:104: 00000100:00100000:2.0:1788891043.355915:0:14768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891043.355994:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996280064 00000100:00100000:1.0:1788891043.356005:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996280064 00000100:00100000:2.0:1788891043.356048:0:14768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891043.357761:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891043.357780:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:14768:x1875787996280064:12345-0@lo:104: 00010000:00010000:1.0:1788891043.357798:0:14320:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891043.358149:0:14768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14768:1875787996280064:0@lo:104: 00010000:00010000:1.0:1788891043.358157:0:14320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788891043.358165:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:14768:x1875787996280064:12345-0@lo:104: Request processed in 394us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891043.358194:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788891043.358209:0:14768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891043.358283:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891043.358290:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891043.358299:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87a00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788891043.358304:0:14324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891043.358313:0:14324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891043.358321:0:14324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891043.358327:0:14324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788891043.358403:0:14324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891043.358410:0:14324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788891043.358443:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891043.358451:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec3feee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3fef5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891043.358468:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891043.358484:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891043.358486:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891043.358549:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996280192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891043.358589:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891043.358652:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996280192 00000100:00100000:2.0:1788891043.358659:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996280192 00010000:00010000:2.0:1788891043.358690:0:14323:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3feee expref: 12 pid: 14329 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891043.358719:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891043.358727:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:3279:x1875787996280192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891043.358739:0:14323:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891043.358744:0:14323:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3feee expref: 12 pid: 14329 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358756:0:14323:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3feee expref: 12 pid: 14329 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358771:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1f4edca00/0x9161b78f8ec3fef5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3feee expref: 12 pid: 14329 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358785:0:14323:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358792:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358812:0:14323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358819:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358825:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358831:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358837:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891043.358841:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358848:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358870:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891043.358878:0:14323:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891043.358918:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:3279:x1875787996280192:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891043.358925:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788891043.359014:0:14768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891043.359023:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891043.359035:0:14768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec3ff2d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891043.359057:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996280192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788891043.382622:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788891043.895220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891043.895228:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788891043.895231:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891043.895243:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788891043.895245:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788891043.895248:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788891043.895251:0:8:0:(import.c:65:import_set_state_nolock()) ffff9da1f023b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891043.895263:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9da1f023b800 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:2.0:1788891043.895299:0:8:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f52c2d80 x1875787996280320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891043.895346:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996280320:0@lo:38:kworker.0 00000100:00100000:2.0:1788891043.895417:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891043.900556:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996280320 00000100:00100000:3.0:1788891043.900568:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996280320 00000100:00100000:3.0:1788891043.900616:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891043.900625:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1875787996280320:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788891043.900654:0:14338:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1788891043.900691:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9161b78f8ec3ff34 00000004:00100000:3.0:1788891043.900708:0:14338:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788891043.900843:0:14338:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891043.900932:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875787996280320:12345-0@lo:38:kworker.0 Request processed in 307us (5514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891043.900948:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788891043.900994:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9da1f52c2d80 x1875787996280320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788891043.901055:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788891043.901063:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788891043.901068:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788891043.901070:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f023b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788891043.901076:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875787996280320:0@lo:38:kworker.0 00010000:00010000:2.0:1788891044.406675:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788891044.662689:0:14333:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788891044.662697:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da0c1acc000 from 10 10000000:01000000:0.0:1788891044.662702:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788891044.662752:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891044.662763:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891044.662776:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891044.662801:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996280448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891044.662897:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891044.662960:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c856f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891044.663406:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996280448 00000100:00100000:2.0:1788891044.663414:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996280448 00000100:00100000:2.0:1788891044.663470:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788891044.663481:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+11:14333:x1875787996280448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891044.663494:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891044.663508:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ff3b expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.663531:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff3b expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.663556:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff3b expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891044.663566:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87e00, rc 0) 00000100:00100000:2.0:1788891044.663618:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14333:x1875787996280448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891044.663640:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788891044.664068:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996280448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891044.664084:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891044.664094:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891044.664148:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996280576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788891044.664233:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891044.664255:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c856f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891044.664766:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996280576 00000100:00100000:1.0:1788891044.664773:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996280576 00000100:00100000:1.0:1788891044.664815:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788891044.664825:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14333:x1875787996280576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891044.665074:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14333:x1875787996280576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891044.665082:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788891044.665219:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996280576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891044.665266:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996280704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788891044.665321:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891044.665349:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201c54cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891044.665407:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996280704 00000100:00100000:2.0:1788891044.665412:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996280704 00000100:00100000:2.0:1788891044.665441:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788891044.665447:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14333:x1875787996280704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891044.665586:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:14333:x1875787996280704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891044.665593:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788891044.665737:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996280704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788891044.669045:0:14837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788891044.671257:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788891044.671335:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788891044.671347:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891044.671359:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891045.430922:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891046.454266:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788891046.866661:0:15017:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788891046.866666:0:15017:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788891046.866807:0:15017:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9da1d0e5a800 00000020:01000004:2.0:1788891046.866823:0:15017:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788891046.866834:0:15017:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788891046.866847:0:15017:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9da201c63370) 00000020:00000080:2.0:1788891046.866861:0:15017:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788891046.882351:0:15017:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788891046.882610:0:15017:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788891046.883400:0:15017:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788891046.884428:0:15017:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788891046.884635:0:15017:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788891046.884970:0:15017:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1788891046.885058:0:15017:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 403: rc = 0 00100000:10000000:2.0:1788891046.885225:0:15017:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:2.0:1788891046.885698:0:15017:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 541: rc = 0 00100000:10000000:2.0:1788891046.885926:0:15017:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 541: rc = 0 00100000:10000000:2.0:1788891046.886298:0:15017:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 541: rc = 0 00100000:10000000:2.0:1788891046.887265:0:15017:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 541: rc = 0 00100000:10000000:2.0:1788891046.887507:0:15017:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 541: rc = 0 00100000:10000000:2.0:1788891046.887731:0:15017:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 541: rc = 0 00000020:00000080:2.0:1788891046.891448:0:15017:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788891046.891460:0:15017:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788891046.891471:0:15017:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9161b78f8ec3ff50 00000020:01000004:2.0:1788891046.891480:0:15017:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788891046.891500:0:15017:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788891046.891504:0:15017:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788891046.891509:0:15017:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788891046.891514:0:15017:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788891046.891524:0:15017:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9da201c60000) 00000020:00000080:2.0:1788891046.891537:0:15017:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788891046.892564:0:15017:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891046.892704:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788891046.892711:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788891046.893235:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788891046.893241:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788891046.893405:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788891046.893410:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788891046.896624:0:15017:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891046.896784:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788891046.896790:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788891046.897566:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788891046.897572:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788891046.910067:0:15017:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891046.910477:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788891046.910484:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788891046.911822:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788891046.911832:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788891046.912823:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788891046.912832:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788891046.914721:0:15017:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788891046.914904:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788891046.914910:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788891046.917566:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788891046.917583:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788891046.941580:0:15017:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788891046.941796:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788891046.941802:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788891046.942956:0:15017:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788891046.942966:0:15017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788891046.943484:0:15017:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788891046.943508:0:15017:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788891046.943515:0:15017:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788891046.951695:0:15017:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788891046.951745:0:15017:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.118@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788891046.951750:0:15017:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788891046.951755:0:15017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788891046.951757:0:15017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891046.951758:0:15017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891046.951759:0:15017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891046.951760:0:15017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891046.951761:0:15017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891046.951763:0:15017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891046.951765:0:15017:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788891046.951768:0:15017:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788891046.951770:0:15017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788891046.951771:0:15017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788891046.951772:0:15017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891046.951773:0:15017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891046.951774:0:15017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891046.951775:0:15017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891046.951776:0:15017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891046.951777:0:15017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891046.951778:0:15017:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788891046.951804:0:15017:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788891046.951824:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996280832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788891046.951894:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891046.952028:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788891046.952115:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996280832 00000100:00100000:0.0:1788891046.952123:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996280832 00000100:00100000:0.0:1788891046.952354:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788891046.952364:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:15017:x1875787996280832:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788891046.952407:0:14329:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788891046.952410:0:14329:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788891046.952414:0:14329:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788891046.974002:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:15017:x1875787996280832:12345-0@lo:253:mount.lustre.0 Request processed in 21629us (22097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891046.974022:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788891046.974823:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996280832:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788891046.974841:0:15017:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788891046.974844:0:15017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788891046.974846:0:15017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788891046.974847:0:15017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891046.974848:0:15017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891046.974849:0:15017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891046.974850:0:15017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891046.974859:0:15017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788891046.974862:0:15017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891046.974863:0:15017:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788891046.974887:0:15017:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9da1d0e5a800 from lustre-OST0000 10000000:01000000:0.0:1788891046.974916:0:15017:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788891046.974919:0:15017:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788891046.974927:0:15017:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9da1fb8c3370 local copy 00010000:00010000:0.0:1788891046.974937:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891046.975236:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996280960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891046.975284:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891046.975330:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f81acd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788891046.975409:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996280960 00000100:00100000:1.0:1788891046.975416:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996280960 00000100:00100000:1.0:1788891046.975467:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788891046.975477:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:15017:x1875787996280960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891046.975645:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:15017:x1875787996280960:12345-0@lo:501:mount.lustre.0 Request processed in 169us (360us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788891046.975654:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788891046.975940:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996280960:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788891046.975955:0:15017:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788891046.976098:0:15017:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788891046.976105:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891046.976114:0:15017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891046.976154:0:15017:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9da1d0e5a800 10000000:01000000:0.0:1788891046.976160:0:15017:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788891046.976164:0:15017:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9da1fb8c3370 10000000:01000000:0.0:1788891046.976199:0:15017:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788891046.976203:0:15017:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9da1fb8c3370 from 1 10000000:01000000:0.0:1788891046.976206:0:15017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788891046.976233:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb8c00/0x9161b78f8ec3ff5e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891046.976240:0:15017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da201cb8c00/0x9161b78f8ec3ff5e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891046.976249:0:15017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da201cb8c00/0x9161b78f8ec3ff5e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891046.976274:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891046.976305:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891046.976335:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f81acd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891046.976394:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996281088 00000100:00100000:2.0:1788891046.976398:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996281088 00000100:00100000:2.0:1788891046.976424:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788891046.976430:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+12:15017:x1875787996281088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891046.976439:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891046.976452:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c9c87800/0x9161b78f8ec3ff65 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ff5e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891046.976472:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c9c87800/0x9161b78f8ec3ff65 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff5e expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891046.976482:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c9c87800/0x9161b78f8ec3ff65 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff5e expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891046.976503:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87800, rc 0) 00000100:00100000:2.0:1788891046.976541:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+13:15017:x1875787996281088:12345-0@lo:101:mount.lustre.0 Request processed in 110us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891046.976546:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788891046.976672:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891046.976683:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da201cb8c00/0x9161b78f8ec3ff5e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff65 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891046.976691:0:15017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da201cb8c00/0x9161b78f8ec3ff5e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ff65 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891046.976706:0:15017:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788891046.976727:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb8c00/0x9161b78f8ec3ff5e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff65 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891046.976734:0:15017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da201cb8c00/0x9161b78f8ec3ff5e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff65 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891046.976741:0:15017:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788891046.976745:0:15017:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891046.976749:0:15017:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788891046.976751:0:15017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788891046.976765:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9200/0x9161b78f8ec3ff6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891046.976771:0:15017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da201cb9200/0x9161b78f8ec3ff6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891046.976778:0:15017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da201cb9200/0x9161b78f8ec3ff6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891046.976797:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891046.976822:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891046.976839:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f81acd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891046.976905:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996281216 00000100:00100000:2.0:1788891046.976910:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996281216 00000100:00100000:2.0:1788891046.977016:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788891046.977024:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+13:15017:x1875787996281216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788891046.977032:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891046.977041:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c9c86400/0x9161b78f8ec3ff73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ff6c expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891046.977066:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c9c86400/0x9161b78f8ec3ff73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff6c expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891046.977075:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c9c86400/0x9161b78f8ec3ff73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff6c expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891046.977082:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86400, rc 0) 00000100:00100000:2.0:1788891046.977124:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281216:12345-0@lo:101:mount.lustre.0 Request processed in 101us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891046.977143:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788891046.977251:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891046.977261:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da201cb9200/0x9161b78f8ec3ff6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff73 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891046.977268:0:15017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da201cb9200/0x9161b78f8ec3ff6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ff73 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891046.977883:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788891046.978668:0:15017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891046.978896:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788891046.978939:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788891046.978972:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788891046.979015:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788891046.979060:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788891046.979091:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788891046.979244:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788891046.979253:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788891046.979329:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891046.979387:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891046.979786:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891046.979849:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996281344 00000100:00100000:0.0:1788891046.979920:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996281344 00000100:00100000:0.0:1788891046.979960:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788891046.979971:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891046.980467:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281344:12345-0@lo:501:mount.lustre.0 Request processed in 496us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891046.980475:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788891046.980583:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891046.980621:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891046.980663:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891046.980678:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891046.980726:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996281472 00000100:00100000:0.0:1788891046.980730:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996281472 00000100:00100000:0.0:1788891046.980748:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788891046.980755:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891046.981236:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281472:12345-0@lo:503:mount.lustre.0 Request processed in 478us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891046.981245:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788891046.981431:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281472:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891046.982434:0:15017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891046.982584:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891046.982645:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891046.982745:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891046.982784:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996281600 00000100:00100000:0.0:1788891046.982791:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996281600 00000100:00100000:0.0:1788891046.982936:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788891046.982945:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891046.983272:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281600:12345-0@lo:502:mount.lustre.0 Request processed in 327us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891046.983280:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788891046.983429:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891046.983751:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788891046.983804:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788891046.983834:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788891046.983958:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788891046.983996:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788891046.984044:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788891046.984107:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788891046.984153:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788891046.984217:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788891046.984266:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788891046.984313:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788891046.984364:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788891046.984400:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891046.984457:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891046.984631:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891046.984946:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996281728 00000100:00100000:0.0:1788891046.984960:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996281728 00000100:00100000:0.0:1788891046.985053:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788891046.985065:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891046.985290:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281728:12345-0@lo:502:mount.lustre.0 Request processed in 227us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891046.985298:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788891046.985398:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891046.985477:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788891046.985501:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788891046.986779:0:15031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788891046.986791:0:15031:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788891046.986798:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788891046.986800:0:15031:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788891046.986805:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788891046.986819:0:15031:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9da1c52619b8) 00000020:00000080:1.0:1788891046.986840:0:15031:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788891046.986846:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788891046.986987:0:15031:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da1d0e5a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788891046.986994:0:15031:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788891046.987001:0:15031:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9161b78f8ec3ff81 00010000:00010000:1.0:1788891046.991016:0:15031:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788891046.991627:0:15031:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788891046.993995:0:15031:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788891046.996133:0:15031:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788891046.996147:0:15031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891046.996154:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891046.996156:0:15031:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788891046.996160:0:15031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788891046.996163:0:15031:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788891046.996165:0:15031:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788891046.996184:0:15031:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788891046.996187:0:15031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788891046.996190:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891046.996192:0:15031:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788891046.996195:0:15031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891046.996198:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891046.996199:0:15031:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788891046.996202:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788891046.996204:0:15031:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788891046.996207:0:15031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891046.996209:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891046.996210:0:15031:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788891046.996213:0:15031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788891046.996215:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891046.996216:0:15031:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788891046.996220:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788891046.996276:0:15031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788891046.996280:0:15031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788891046.996282:0:15031:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788891046.996285:0:15031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788891046.998800:0:15017:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788891046.998849:0:15017:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788891046.998940:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9200/0x9161b78f8ec3ff6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff73 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891046.998955:0:15017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da201cb9200/0x9161b78f8ec3ff6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff73 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891046.998963:0:15017:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1d0e5a800 from 1 10000000:01000000:3.0:1788891046.998966:0:15017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788891046.999005:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891046.999012:0:15017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891046.999023:0:15017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891046.999046:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891046.999111:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891046.999164:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788891046.999321:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996281856 00000100:00100000:1.0:1788891046.999330:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996281856 00000100:00100000:1.0:1788891046.999369:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788891046.999379:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+14:15017:x1875787996281856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891046.999392:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891046.999404:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ff88 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891046.999428:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff88 expref: 15 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891046.999438:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff88 expref: 15 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891046.999446:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e200, rc 0) 00000100:00100000:3.0:1788891046.999624:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891046.999639:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891046.999647:0:15017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891047.000248:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788891047.000726:0:15017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788891047.000981:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996281856:12345-0@lo:101:mount.lustre.0 Request processed in 1601us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891047.000991:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000040:00080000:3.0:1788891047.001251:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788891047.001301:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788891047.001372:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788891047.001380:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788891047.001449:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891047.001618:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891047.001714:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788891047.008424:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996281984 00000100:00100000:2.0:1788891047.008436:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996281984 00000100:00100000:2.0:1788891047.008599:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788891047.008611:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996281984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891047.009027:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996281984:12345-0@lo:501:mount.lustre.0 Request processed in 417us (7407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891047.009037:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788891047.009139:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996281984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891047.009224:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891047.009275:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891047.009511:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788891047.009638:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996282112 00000100:00100000:0.0:1788891047.009644:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996282112 00000100:00100000:0.0:1788891047.009672:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788891047.009680:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996282112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891047.009846:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996282112:12345-0@lo:503:mount.lustre.0 Request processed in 167us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891047.009854:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788891047.009960:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891047.010460:0:15017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891047.010550:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891047.010596:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891047.010609:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788891047.010759:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996282240 00000100:00100000:0.0:1788891047.010764:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996282240 00000100:00100000:0.0:1788891047.010786:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788891047.010793:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996282240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891047.010963:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996282240:12345-0@lo:502:mount.lustre.0 Request processed in 169us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891047.010970:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788891047.011100:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891047.011393:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788891047.011447:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788891047.011579:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788891047.011624:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788891047.011661:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788891047.011729:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788891047.011767:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788891047.011803:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788891047.011832:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891047.011944:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891047.011966:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0c91f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788891047.012037:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996282368 00000100:00100000:0.0:1788891047.012042:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996282368 00000100:00100000:0.0:1788891047.012066:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788891047.012073:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ceb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996282368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891047.012246:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ceb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996282368:12345-0@lo:502:mount.lustre.0 Request processed in 172us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891047.012253:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788891047.012333:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891047.012404:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788891047.012413:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788891047.013644:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891047.013655:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891047.013658:0:15035:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788891047.013665:0:15035:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1d0e5a800 00000020:00000080:3.0:1788891047.013667:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788891047.013674:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891047.013676:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891047.013678:0:15035:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788891047.013680:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891047.013682:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891047.013684:0:15035:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788891047.013687:0:15035:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1d0e5a800 00000020:00000080:3.0:1788891047.013690:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788891047.013790:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891047.013794:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891047.013796:0:15035:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788891047.013799:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891047.013807:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891047.013809:0:15035:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788891047.013813:0:15035:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9da1d0e5a800 00000020:00000080:3.0:1788891047.013815:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788891047.014308:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891047.014313:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891047.014314:0:15035:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788891047.014318:0:15035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788891047.018459:0:15017:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788891047.018503:0:15017:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788891047.018520:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.018534:0:15017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891047.018589:0:15017:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788891047.018592:0:15017:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9da1d0e5a800 10000000:01000000:0.0:1788891047.018595:0:15017:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9da1d0e5a800 10000000:01000000:0.0:1788891047.018599:0:15017:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788891047.018604:0:15017:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1d0e5a800 from 1 10000000:01000000:0.0:1788891047.018607:0:15017:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788891047.018644:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9600/0x9161b78f8ec3ff96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.018652:0:15017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da201cb9600/0x9161b78f8ec3ff96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.018664:0:15017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da201cb9600/0x9161b78f8ec3ff96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891047.018688:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891047.018758:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891047.018797:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1f81accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891047.018943:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996282496 00000100:00100000:0.0:1788891047.018950:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996282496 00000100:00100000:0.0:1788891047.018992:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788891047.019002:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996282496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891047.019014:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891047.019026:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da201cb8400/0x9161b78f8ec3ff9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec3ff96 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.019049:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da201cb8400/0x9161b78f8ec3ff9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff96 expref: 16 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.019071:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da201cb8400/0x9161b78f8ec3ff9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff96 expref: 16 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.019080:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8400, rc 0) 00000100:00100000:0.0:1788891047.019140:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996282496:12345-0@lo:101:mount.lustre.0 Request processed in 139us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891047.019148:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788891047.019231:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891047.019245:0:15017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da201cb9600/0x9161b78f8ec3ff96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff9d expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.019253:0:15017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da201cb9600/0x9161b78f8ec3ff96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec3ff9d expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788891047.019829:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788891047.020970:0:15017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788891047.021278:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788891047.021324:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788891047.021356:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788891047.021426:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788891047.021467:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788891047.022804:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788891047.022951:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788891047.022992:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788891047.023045:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788891047.023084:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788891047.023120:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788891047.023207:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788891047.023245:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788891047.023277:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788891047.023322:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788891047.023354:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788891047.023391:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788891047.023439:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788891047.023474:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788891047.024373:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788891047.024438:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788891047.024475:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788891047.024510:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788891047.024573:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788891047.024616:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788891047.024648:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788891047.024695:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788891047.024739:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788891047.028490:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788891047.028533:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788891047.028637:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891047.028703:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891047.028738:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891047.028957:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996282624 00000100:00100000:2.0:1788891047.028965:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996282624 00000100:00100000:2.0:1788891047.029022:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788891047.029033:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996282624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891047.029322:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996282624:12345-0@lo:501:mount.lustre.0 Request processed in 290us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891047.029331:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788891047.030062:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891047.030101:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788891047.030157:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891047.030204:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891047.030213:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996282752 00000100:00100000:2.0:1788891047.030217:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996282752 00000100:00100000:2.0:1788891047.030259:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788891047.030266:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996282752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891047.030423:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996282752:12345-0@lo:503:mount.lustre.0 Request processed in 157us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891047.030430:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788891047.033271:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788891047.033817:0:15017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788891047.033911:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891047.033984:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891047.034030:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788891047.034182:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996282880 00000100:00100000:2.0:1788891047.034189:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996282880 00000100:00100000:2.0:1788891047.034236:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788891047.034245:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996282880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891047.034453:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996282880:12345-0@lo:502:mount.lustre.0 Request processed in 208us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891047.034461:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788891047.035156:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996282880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891047.035421:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788891047.035479:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788891047.035514:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788891047.035578:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788891047.035617:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788891047.035667:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788891047.035704:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788891047.035736:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788891047.035782:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788891047.035817:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788891047.035862:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788891047.035912:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788891047.035948:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788891047.035995:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788891047.036046:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788891047.036083:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788891047.036118:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788891047.036196:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788891047.036227:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788891047.036268:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788891047.036308:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788891047.036340:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788891047.036373:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788891047.036418:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788891047.036454:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788891047.036486:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788891047.036537:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788891047.036573:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788891047.036606:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788891047.036654:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788891047.036693:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788891047.036724:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788891047.036757:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788891047.036800:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788891047.036834:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788891047.036900:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788891047.036936:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788891047.036968:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788891047.037011:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788891047.037043:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788891047.037084:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996283008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891047.037191:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891047.042263:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891047.043639:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996283008 00000100:00100000:0.0:1788891047.043653:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996283008 00000100:00100000:0.0:1788891047.043719:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788891047.043731:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996283008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891047.044033:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996283008:12345-0@lo:502:mount.lustre.0 Request processed in 303us (6865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891047.044041:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788891047.044076:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996283008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788891047.044221:0:15017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788891047.044236:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788891047.045090:0:15040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788891047.045108:0:15040:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9da1c5264d28) 00000020:00000080:1.0:1788891047.045140:0:15040:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788891047.045234:0:15040:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da1d0e5a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788891047.045238:0:15040:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9da1d0e5a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788891047.045240:0:15040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1d0e5a800 3 00010000:00080000:1.0:1788891047.045265:0:15040:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da1f4ff0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.118@tcp at head 00010000:00010000:1.0:1788891047.047868:0:15040:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788891047.048064:0:15040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788891047.048101:0:15040:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788891047.048114:0:15040:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9161b78f8ec3ffab 00000100:00080000:1.0:1788891047.048139:0:15040:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788891047.048146:0:15040:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9da1f4ff0000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:1.0:1788891047.048206:0:15040:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f52c9880 x1875787996283136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788891047.048228:0:15040:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788891047.048281:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1875787996283136:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788891047.048352:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891047.048410:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996283136 00000100:00100000:3.0:1788891047.048418:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996283136 00000100:00100000:3.0:1788891047.048448:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788891047.048456:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1875787996283136:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788891047.048480:0:14336:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1788891047.048523:0:14336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9161b78f8ec3ffb2 00000004:00100000:3.0:1788891047.048536:0:14336:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788891047.048566:0:14336:0:(import.c:65:import_set_state_nolock()) ffff9da1ffeb8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891047.048616:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875787996283136:12345-0@lo:38:llog_process_th.0 Request processed in 159us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891047.048623:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788891047.048660:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9da1f52c9880 x1875787996283136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891047.048669:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788891047.048676:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788891047.048682:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788891047.048685:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788891047.048688:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f4ff0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788891047.048701:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1875787996283136:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788891047.048827:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891047.048832:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788891047.048835:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891047.048838:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788891047.049040:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788891047.049050:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996283264:0@lo:400:kworker.0 00000100:00100000:1.0:1788891047.049083:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891047.049121:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996283264 00000100:00100000:1.0:1788891047.049137:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996283264 00000100:00100000:1.0:1788891047.049200:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788891047.049207:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996283264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891047.049255:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996283264:12345-0@lo:400:kworker.0 Request processed in 49us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891047.049262:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788891047.049331:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9da1f52c3100 x1875787996283264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788891047.049343:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996283264:0@lo:400:kworker.0 00000040:00080000:1.0:1788891047.050699:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788891047.051236:0:15017:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788891047.051263:0:15017:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788891047.051279:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9600/0x9161b78f8ec3ff96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff9d expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.051290:0:15017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da201cb9600/0x9161b78f8ec3ff96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3ff9d expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788891047.051339:0:15017:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788891047.051341:0:15017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788891047.051342:0:15017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788891047.051344:0:15017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788891047.051345:0:15017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788891047.051346:0:15017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788891047.051348:0:15017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788891047.051350:0:15017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788891047.051351:0:15017:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788891047.051355:0:15017:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788891047.051357:0:15017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788891047.051359:0:15017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788891047.051360:0:15017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788891047.051361:0:15017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788891047.051362:0:15017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788891047.051363:0:15017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788891047.051364:0:15017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788891047.051365:0:15017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788891047.051366:0:15017:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788891047.051386:0:15017:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788891047.051402:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996283392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788891047.051456:0:15017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891047.051488:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996283392 00000100:00100000:1.0:1788891047.051494:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996283392 00000100:00100000:1.0:1788891047.051533:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788891047.051542:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15017:x1875787996283392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788891047.051585:0:14329:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788891047.051601:0:14329:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788891047.052222:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158a9c0 going to sleep for 11 seconds 20000000:01000000:2.0:1788891047.076459:0:14329:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788891047.076481:0:14329:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788891047.076544:0:14352:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788891047.076550:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788891047.076572:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.076590:0:14352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff1f expref: 16 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.076598:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.076635:0:14352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ff1f expref: 16 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.076648:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff1f expref: 16 pid: 14331 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891047.076662:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14352:1875787996283520:0@lo:104: 00000100:00100000:1.0:1788891047.076725:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891047.076771:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891047.076879:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996283520 00000100:00100000:0.0:1788891047.076887:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996283520 00000100:00100000:0.0:1788891047.076936:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788891047.076946:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:14352:x1875787996283520:12345-0@lo:104: 00010000:00010000:0.0:1788891047.076958:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.077026:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788891047.077033:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:14352:x1875787996283520:12345-0@lo:104: Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891047.077041:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788891047.077066:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891047.077086:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.077094:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edda00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:0.0:1788891047.077098:0:14325:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.077107:0:14325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788891047.077115:0:14325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891047.077120:0:14325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788891047.077165:0:14325:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.077214:0:14325:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788891047.077235:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.077242:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1f4edda00/0x9161b78f8ec3ff1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ff26 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891047.077260:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891047.077263:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891047.077265:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891047.077292:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996283648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891047.077321:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891047.077342:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14352:1875787996283520:0@lo:104: 00010000:00010000:2.0:1788891047.077363:0:14352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891047.077576:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996283648 00000100:00100000:1.0:1788891047.077580:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996283648 00010000:00010000:1.0:1788891047.077598:0:14321:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff1f expref: 17 pid: 14331 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891047.077629:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788891047.077636:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:3281:x1875787996283648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891047.077647:0:14321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891047.077660:0:14321:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff1f expref: 17 pid: 14331 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077670:0:14321:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff1f expref: 17 pid: 14331 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077682:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec3ff26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ff1f expref: 17 pid: 14331 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077695:0:14321:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077702:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788891047.077714:0:14321:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001910332s 00010000:00010000:1.0:1788891047.077718:0:14321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077724:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077730:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077736:0:14321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077741:0:14321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fa00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788891047.077745:0:14321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077760:0:14321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077775:0:14321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077784:0:14321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891047.077812:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:3281:x1875787996283648:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891047.077820:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788891047.077839:0:14352:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077847:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891047.077853:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec3ffb9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891047.077939:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996283648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788891047.083248:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:15017:x1875787996283392:12345-0@lo:253:mount.lustre.0 Request processed in 31700us (31784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891047.083263:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788891047.083340:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15017:1875787996283392:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788891047.083355:0:15017:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788891047.083359:0:15017:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788891047.083360:0:15017:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788891047.083362:0:15017:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891047.083363:0:15017:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891047.083364:0:15017:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891047.083366:0:15017:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891047.083368:0:15017:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891047.083370:0:15017:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891047.083371:0:15017:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788891047.083391:0:15017:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788891047.087679:0:15017:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788891047.087850:0:15017:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788891047.088010:0:15017:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788891047.088223:0:15017:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788891047.088377:0:15017:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788891047.088595:0:15017:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788891047.089602:0:15017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788891047.123589:0:15017:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788891047.123600:0:15017:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788891047.123635:0:15017:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788891047.123691:0:15017:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788891047.123704:0:15017:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788891047.123732:0:15017:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788891047.480222:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891048.054343:0:3278:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891038/real 1788891038] req@ffff9da1cafa5500 x1875787996277504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891048.054373:0:3278:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9da1cafa5500 x1875787996277504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891048.054397:0:3278:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788891038/real 1788891038] req@ffff9da1cafa7480 x1875787996277376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891048.054411:0:3278:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9da1cafa7480 x1875787996277376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788891048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788891048.054428:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f0238000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891048.054448:0:3278:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788891048.054452:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996277504:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788891048.054458:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1cae35000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891048.054464:0:3278:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788891048.054467:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996277376:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788891048.055293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891048.055298:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788891048.055300:0:8:0:(import.c:65:import_set_state_nolock()) ffff9da1cae35000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788891048.055306:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 262 00000100:00080000:3.0:1788891048.055311:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788891048.055317:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9da1cae35000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788891048.055336:0:8:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1cafa5500 x1875787996283904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788891048.055351:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788891048.055354:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788891048.055356:0:8:0:(import.c:65:import_set_state_nolock()) ffff9da1f0238000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788891048.055358:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 262 00000100:00080000:3.0:1788891048.055368:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788891048.055371:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9da1f0238000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:3.0:1788891048.055385:0:8:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1cafa5c00 x1875787996284032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891048.055435:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3282:1875787996283776:0@lo:400:kworker.0 00000100:00100000:3.0:1788891048.055905:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891048.055974:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996284160:0@lo:400:kworker.0 00000100:00100000:3.0:1788891048.056006:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891048.056028:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788891048.056033:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996284288:0@lo:400:kworker.0 00000100:00100000:3.0:1788891048.056067:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891048.056102:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996283776 00000100:00100000:3.0:1788891048.056123:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996283776 00000100:00100000:3.0:1788891048.056186:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788891048.056208:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:3282:x1875787996283776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891048.056256:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:3282:x1875787996283776:12345-0@lo:400:kworker.0 Request processed in 61us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891048.056264:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788891048.056297:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996284160 00000100:00100000:3.0:1788891048.056301:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996284160 00000100:00100000:3.0:1788891048.056320:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996284288 00000100:00100000:3.0:1788891048.056322:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996284288 00000100:00100000:3.0:1788891048.056349:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891048.056355:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996284160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891048.056401:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996284160:12345-0@lo:400:kworker.0 Request processed in 45us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891048.056417:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891048.056430:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788891048.056435:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996284288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891048.056464:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996284288:12345-0@lo:400:kworker.0 Request processed in 29us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891048.056470:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788891048.056725:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788891048.058676:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1cafa5f80 x1875787996284288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891048.058694:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996284288:0@lo:400:kworker.0 00010000:00080000:3.0:1788891048.058709:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1cafa4e00 x1875787996284160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891048.058718:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996284160:0@lo:400:kworker.0 00000100:00100000:3.0:1788891048.058758:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3282:1875787996283776:0@lo:400:kworker.0 00000100:00100000:3.0:1788891048.058779:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996283904:0@lo:8:kworker.0 00000100:00100000:3.0:1788891048.058837:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891048.058882:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996284032:0@lo:8:kworker.0 00000100:00100000:3.0:1788891048.058909:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891048.058986:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996283904 00000100:00100000:2.0:1788891048.058992:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996283904 00000100:00100000:2.0:1788891048.059027:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996284032 00000100:00100000:2.0:1788891048.059030:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996284032 00000100:00100000:2.0:1788891048.059188:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788891048.059345:0:15020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3278:x1875787996283904:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788891048.059374:0:15020:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1788891048.059406:0:15020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec3ffc0 00002000:00100000:2.0:1788891048.059419:0:15020:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9da1c5242800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788891048.059423:0:15020:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788891048.059426:0:15020:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788891048.059894:0:15020:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788891048.059917:0:15020:0:(import.c:65:import_set_state_nolock()) ffff9da1c5244000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891048.060015:0:15020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1875787996283904:12345-0@lo:8:kworker.0 Request processed in 818us (1177us total) trans 0 rc 0/0 00010000:00080000:3.0:1788891048.060924:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1cafa5500 x1875787996283904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891048.060935:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788891048.060942:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788891048.060951:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788891048.060956:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788891048.060966:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1cae35000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788891048.060989:0:3278:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788891048.060995:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996283904:0@lo:8:kworker.0 00000004:00080000:0.0:1788891048.061005:0:14358:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788891048.061061:0:14359:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788891048.061084:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14359:1875787996284544:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788891048.061138:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891048.061163:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c36f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891048.061211:0:15021:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788891048.061219:0:15021:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788891048.061316:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996284416:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788891048.061341:0:14358:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 271910171607ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788891048.061351:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891048.061395:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996284416 00000100:00100000:3.0:1788891048.061399:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996284416 00000100:00100000:3.0:1788891048.061441:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891048.061450:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875787996284416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788891048.061465:0:15022:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788891048.061567:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875787996284416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891048.061574:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788891048.061605:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da1cafa5500 x1875787996284416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891048.061688:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996284416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788891048.061727:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996284544 00000100:00100000:3.0:1788891048.061731:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996284544 00000100:00100000:2.0:1788891048.063165:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788891048.063317:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891048.063325:0:15020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3278:x1875787996284032:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788891048.063345:0:15020:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788891048.063408:0:15020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3278:x1875787996284032:12345-0@lo:8:kworker.0 Request processed in 82us (4497us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788891048.063429:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788891048.063469:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788891048.063515:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f0238000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788891048.063520:0:3278:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788891048.063524:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996284032:0@lo:8:kworker.0 00000100:00100000:3.0:1788891048.069123:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788891048.069142:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14359:x1875787996284544:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788891048.075622:0:15021:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788891048.075634:0:15021:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788891048.075639:0:15021:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1788891048.083869:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.083880:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.083896:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.083901:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.083907:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.083926:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.084298:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.084307:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.084479:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891048.084493:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891048.084498:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.084508:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891048.084519:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.084529:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.084549:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.084558:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.084576:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.084578:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.084581:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.085116:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.085124:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085135:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.085139:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.085145:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085157:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085197:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085212:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085248:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891048.085257:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891048.085262:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085270:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891048.085273:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085282:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085295:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085302:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3ffce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.085315:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.085317:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.085318:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.088934:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.088961:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.088979:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.088984:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.088991:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.089007:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.089019:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.089027:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.093913:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891048.093937:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891048.093946:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.093960:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891048.093965:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.093976:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.094005:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.094013:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec3ffd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.094030:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.094032:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.094034:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.094813:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.094821:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.094834:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.094839:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.094845:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.094858:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.094867:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.094876:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.094941:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788891048.095412:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.095418:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.095427:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.095430:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.095435:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.095444:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.095452:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.095460:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095615:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891048.095623:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095630:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.095633:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095641:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095660:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095668:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec3ffdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095682:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.095686:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095703:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edde00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.095707:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095715:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095726:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.095734:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.095736:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.095738:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.095815:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.095821:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec3ffe3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.097030:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.097817:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.097826:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.097847:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.097854:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.097861:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.097874:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.097885:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.097894:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.099228:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891048.099247:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.099254:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.099266:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.099271:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.099283:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.099317:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.099326:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec3ffea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.099352:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.099355:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.099359:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788891048.100008:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788891048.100016:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100027:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=271s v=(0 0) 00010000:00010000:2.0:1788891048.100031:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891048.100037:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100049:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100057:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100064:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100091:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891048.100101:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.100116:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100124:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86c00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.100128:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100136:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100151:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100158:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4736c0a/0x9161b78f8ec3fff1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.100453:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.100456:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.100458:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.103660:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.103672:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103689:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.103693:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.103700:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103714:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103737:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103746:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103766:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891048.103778:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891048.103783:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103792:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891048.103797:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103806:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103824:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103831:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec3fff8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.103847:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.103855:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.103856:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.108392:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.108407:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108423:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.108428:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.108434:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108448:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108458:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108531:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108552:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891048.108565:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891048.108571:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108579:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd000 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891048.108584:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108604:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108622:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108630:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000deb5d9c7/0x9161b78f8ec3ffff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.108647:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.108649:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.108651:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.109151:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.109157:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109182:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.109186:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.109191:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109201:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109209:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109223:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109236:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891048.109245:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891048.109249:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109256:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edce00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891048.109259:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109267:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109278:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109286:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b2bbfc1/0x9161b78f8ec40006 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.109298:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.109300:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.109302:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.111849:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.111867:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.111882:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.111887:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.111894:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.111906:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.111916:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.111924:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.111993:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788891048.112693:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.112699:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.112709:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.112712:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.112717:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.112727:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.112743:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.112749:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112804:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891048.112811:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112818:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edde00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.112828:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112836:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112854:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112861:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d678afb/0x9161b78f8ec4000d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112876:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.112879:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112885:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.112888:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112895:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112904:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.112911:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.112918:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.112920:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.112988:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.112994:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000519059c8/0x9161b78f8ec40014 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891048.113457:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.113464:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.113586:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.113589:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.113594:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.113604:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.113612:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.113631:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.113680:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.113687:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.113695:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.113699:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.113708:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.113723:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.113730:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.113732:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.113734:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.113794:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.113800:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000addeef57/0x9161b78f8ec4001b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891048.114265:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.114271:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.114279:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.114283:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.114287:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.114296:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.114304:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.114310:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.114372:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.114377:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.114384:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.114387:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.114396:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.114414:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.114423:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.114425:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.114427:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.114549:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.114554:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc755ef7/0x9161b78f8ec40022 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891048.114997:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.115003:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.115013:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.115016:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.115021:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.115031:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.115040:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.115047:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.115080:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.115086:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.115094:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edcc00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.115098:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.115116:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.115130:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.115139:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.115142:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.115144:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.115356:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.115362:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000286ec27c/0x9161b78f8ec40029 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891048.115872:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.115880:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.115890:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.115894:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.115899:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.115909:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.115918:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.115926:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.116019:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.116025:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.116156:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.116161:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.116190:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.116203:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.116210:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.116212:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.116214:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.116293:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.116298:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec40030 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.116356:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.117992:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.118002:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118026:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.118030:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.118036:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118048:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118058:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118066:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118090:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788891048.118680:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.118686:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118694:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.118698:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.118702:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118711:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118730:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118738:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118754:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788891048.118764:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891048.118769:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118777:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4eddc00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891048.118782:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118791:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118808:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118817:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec40037 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118832:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891048.118841:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118849:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891048.118852:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118860:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118871:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118879:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be64f966/0x9161b78f8ec4003e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.118890:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.118892:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.118894:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.119918:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.119927:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.119939:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.119943:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.119949:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.119972:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.119981:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.119988:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120003:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891048.120013:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891048.120017:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120024:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891048.120027:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120036:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120049:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120057:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033bbaef4/0x9161b78f8ec40045 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120079:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.120080:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.120082:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.120678:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.120909:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.120915:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120925:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.120929:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.120933:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120944:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120952:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.120959:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.121018:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788891048.121478:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.121484:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.121503:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.121507:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.121513:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.121523:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.121532:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.121539:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121632:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891048.121638:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121646:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.121649:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121658:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121687:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121695:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec4004c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121715:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.121719:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121726:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edda00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.121730:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121738:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121748:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.121755:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.121756:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.121758:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.121816:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.121821:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec40053 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891048.122215:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.122221:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.122230:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.122233:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.122237:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.122257:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.122266:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.122273:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122309:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.122314:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122331:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edca00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.122334:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122342:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122353:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122360:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.122361:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.122363:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.122413:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.122417:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc2a432e/0x9161b78f8ec4005a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891048.122799:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.122804:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.122813:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.122817:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.122821:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.122830:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.122850:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.122858:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122939:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.122945:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122953:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.122956:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122965:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122979:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.122993:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.122996:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.122998:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.123055:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.123061:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f561556/0x9161b78f8ec40061 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788891048.123764:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.123772:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.123782:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.123786:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.123793:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.123803:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.123812:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.123832:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.123880:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.123887:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.123895:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031c00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.123900:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.123909:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.123924:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.123935:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.123937:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.123940:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.123974:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.123979:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000280e4742/0x9161b78f8ec40068 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.124202:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.125114:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.125123:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.125134:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.125138:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.125144:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.125153:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.125162:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.125463:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.125992:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891048.126557:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.126565:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.126574:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.126586:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.126596:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.126617:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.126626:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbfe598/0x9161b78f8ec4006f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.126646:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.126648:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.126651:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788891048.126875:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.126882:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.126895:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.126899:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.126904:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.126915:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.126923:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.126930:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.126985:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788891048.128400:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891048.128409:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.128422:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=271s v=(0 0) 00010000:00010000:3.0:1788891048.128431:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891048.128438:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.128449:0:15021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.128458:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891048.128466:0:15021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128586:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891048.128594:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128602:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.128607:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128615:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128633:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128647:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081092ffa/0x9161b78f8ec40076 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128666:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891048.128670:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128678:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891048.128682:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128689:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128700:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.128709:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.128711:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891048.128713:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891048.128779:0:15021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788891048.128784:0:15021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000302c4296/0x9161b78f8ec4007d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788891048.129039:0:15021:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1788891048.129137:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14359:x1875787996284544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 59999us (67995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891048.129147:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788891048.129225:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14359:1875787996284544:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788891048.129240:0:14359:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788891048.129287:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14359:1875787996284672:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788891048.129326:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891048.129377:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c36f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891048.129404:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996284672 00000100:00100000:3.0:1788891048.129412:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996284672 00000100:00100000:3.0:1788891048.129456:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788891048.129466:0:15020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14359:x1875787996284672:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788891048.129816:0:15020:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1788891048.131753:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788891048.135406:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788891048.137995:0:15020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14359:x1875787996284672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8524us (8662us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788891048.138008:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891048.138287:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14359:1875787996284672:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788891048.138301:0:14359:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788891048.502440:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788891048.695399:0:14333:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788891048.695407:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9da0c1acc000 from 7 10000000:01000000:1.0:1788891048.695412:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788891048.695524:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891048.695537:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891048.695548:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891048.695581:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996284800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788891048.695651:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891048.695736:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891048.704651:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996284800 00000100:00100000:2.0:1788891048.704667:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996284800 00000100:00100000:2.0:1788891048.704750:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788891048.704761:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+15:14333:x1875787996284800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891048.704780:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891048.704800:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec40084 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.704830:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec40084 expref: 16 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.704843:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec40084 expref: 16 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.704854:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86c00, rc 0) 00000100:00100000:2.0:1788891048.704935:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:14333:x1875787996284800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (9283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891048.704943:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788891048.705126:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996284800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891048.705145:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891048.705156:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891048.705239:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996284928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788891048.705280:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891048.705310:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c41f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788891048.705328:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996284928 00000100:00100000:0.0:1788891048.705332:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996284928 00000100:00100000:0.0:1788891048.705359:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788891048.705366:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ceac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:14333:x1875787996284928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788891048.705380:0:14331:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788891048.705396:0:14331:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788891048.705399:0:14331:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788891048.705484:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ceac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:14333:x1875787996284928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891048.705492:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788891048.705594:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996284928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788891048.705649:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788891048.705657:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891048.705665:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891049.526373:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891050.558744:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788891050.742731:0:14371:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891050.742739:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891050.742788:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1788891050.742794:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788891051.574266:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788891051.583546:0:15383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788891052.600680:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788891052.698657:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788891052.698765:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000100:00100000:2.0:1788891053.110557:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891053.110598:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996285056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788891053.110674:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891053.110753:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996285056 00000100:00100000:2.0:1788891053.110760:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996285056 00000100:00100000:2.0:1788891053.110827:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788891053.110837:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996285056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788891053.110874:0:15022:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788891053.110923:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996285056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891053.110931:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788891053.110952:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891053.110991:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788891053.111024:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996285056:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788891053.111151:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891053.111155:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788891053.111159:0:38:0:(import.c:65:import_set_state_nolock()) ffff9da1f0238000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891053.111189:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 271 00000100:00080000:0.0:1788891053.111194:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788891053.111198:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9da1f0238000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:0.0:1788891053.111219:0:38:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da201f8dc00 x1875787996285312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788891053.111489:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788891053.111501:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996285568:0@lo:400:kworker.0 00000100:00100000:3.0:1788891053.111533:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891053.111573:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996285184:0@lo:400:kworker.0 00000100:00100000:3.0:1788891053.111601:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891053.111622:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788891053.111628:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996285440:0@lo:400:kworker.0 00000100:00100000:3.0:1788891053.111647:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891053.111674:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996285568 00000100:00100000:3.0:1788891053.111678:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996285568 00000100:00100000:3.0:1788891053.111708:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996285440 00000100:00100000:3.0:1788891053.111711:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996285440 00000100:00100000:3.0:1788891053.111726:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788891053.111733:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996285568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891053.111770:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996285568:12345-0@lo:400:kworker.0 Request processed in 38us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891053.111777:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788891053.111799:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788891053.111806:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996285440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891053.111838:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996285440:12345-0@lo:400:kworker.0 Request processed in 33us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891053.111844:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788891053.111873:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da201f8e680 x1875787996285568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891053.111884:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996285568:0@lo:400:kworker.0 00010000:00080000:3.0:1788891053.111906:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9da201f8d880 x1875787996285440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891053.111915:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996285440:0@lo:400:kworker.0 00000100:00100000:2.0:1788891053.113339:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996285312:0@lo:8:kworker.0 00000100:00100000:2.0:1788891053.114335:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891053.114515:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996285184 00000100:00100000:2.0:1788891053.114523:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996285184 00000100:00100000:2.0:1788891053.114560:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788891053.114569:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:3279:x1875787996285184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891053.114631:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:3279:x1875787996285184:12345-0@lo:400:kworker.0 Request processed in 63us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891053.114638:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788891053.114702:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891053.115613:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996285312 00000100:00100000:1.0:1788891053.115621:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996285312 00000100:00100000:1.0:1788891053.115650:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788891053.115657:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3278:x1875787996285312:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788891053.115679:0:15104:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788891053.116991:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996285184:0@lo:400:kworker.0 00000100:00100000:1.0:1788891053.136106:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3278:x1875787996285312:12345-0@lo:8:kworker.0 Request processed in 20440us (21765us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788891053.136122:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788891053.136202:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f0238000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788891053.136207:0:3278:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788891053.136211:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996285312:0@lo:8:kworker.0 00010000:00010000:2.0:1788891053.625874:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891054.650438:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891055.670478:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788891056.568067:0:15733:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788891056.568072:0:15733:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788891056.568844:0:15733:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9da1ffeb9000 00000020:01000004:3.0:1788891056.568861:0:15733:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788891056.568876:0:15733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788891056.568889:0:15733:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9da1f02499b8) 00000020:00000080:3.0:1788891056.568906:0:15733:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788891056.586982:0:15733:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788891056.587647:0:15733:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788891056.588613:0:15733:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788891056.588828:0:15733:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788891056.589043:0:15733:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788891056.589636:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1788891056.589785:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:3.0:1788891056.589889:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:3.0:1788891056.590756:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 644: rc = 0 00100000:10000000:3.0:1788891056.591472:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 644: rc = 0 00100000:10000000:3.0:1788891056.591727:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 644: rc = 0 00100000:10000000:3.0:1788891056.592249:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:3.0:1788891056.592490:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:3.0:1788891056.592725:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 644: rc = 0 00000020:00000080:3.0:1788891056.593625:0:15733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788891056.593637:0:15733:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788891056.593646:0:15733:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9161b78f8ec40099 00000020:01000004:3.0:1788891056.593654:0:15733:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788891056.593674:0:15733:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788891056.593678:0:15733:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788891056.593686:0:15733:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788891056.593707:0:15733:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788891056.593711:0:15733:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788891056.602353:0:15733:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788891056.602388:0:15733:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.118@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788891056.602392:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788891056.602394:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788891056.602396:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891056.602397:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891056.602398:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891056.602400:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891056.602401:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891056.602403:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891056.602404:0:15733:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788891056.602408:0:15733:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788891056.602410:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788891056.602411:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788891056.602416:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891056.602417:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891056.602418:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891056.602419:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891056.602420:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891056.602421:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891056.602422:0:15733:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788891056.602445:0:15733:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788891056.602463:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996285696:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788891056.602527:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.602631:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891056.602671:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996285696 00000100:00100000:0.0:1788891056.602678:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996285696 00000100:00100000:0.0:1788891056.602723:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788891056.602732:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15733:x1875787996285696:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788891056.602760:0:14329:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788891056.602763:0:14329:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788891056.602766:0:14329:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788891056.611124:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15733:x1875787996285696:12345-0@lo:253:mount.lustre.0 Request processed in 8378us (8581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891056.611157:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788891056.611531:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996285696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788891056.611551:0:15733:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788891056.611555:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788891056.611557:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788891056.611559:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891056.611560:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891056.611561:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891056.611563:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891056.611565:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891056.611567:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891056.611568:0:15733:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788891056.611598:0:15733:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9da1ffeb9000 from lustre-OST0001 10000000:01000000:3.0:1788891056.611635:0:15733:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788891056.611638:0:15733:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788891056.611648:0:15733:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9da1fb8c3370 local copy 00010000:00010000:3.0:1788891056.611661:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891056.611979:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996285824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891056.612027:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.612124:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788891056.612382:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996285824 00000100:00100000:0.0:1788891056.612390:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996285824 00000100:00100000:0.0:1788891056.612491:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788891056.612503:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15733:x1875787996285824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891056.612852:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15733:x1875787996285824:12345-0@lo:501:mount.lustre.0 Request processed in 350us (823us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788891056.612869:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788891056.612972:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996285824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788891056.613000:0:15733:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788891056.613449:0:15733:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788891056.613459:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.613470:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86000/0x9161b78f8ec3fe46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec3fe4d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891056.613500:0:15733:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9da1ffeb9000 10000000:01000000:3.0:1788891056.613506:0:15733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788891056.613512:0:15733:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788891056.613515:0:15733:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788891056.613520:0:15733:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788891056.613523:0:15733:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788891056.613555:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031800/0x9161b78f8ec400a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.613563:0:15733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c0031800/0x9161b78f8ec400a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.613574:0:15733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c0031800/0x9161b78f8ec400a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891056.613591:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996285952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891056.613629:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.616563:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788891056.618878:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996285952 00000100:00100000:0.0:1788891056.618900:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996285952 00000100:00100000:0.0:1788891056.619306:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788891056.619321:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:15733:x1875787996285952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788891056.619344:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891056.619383:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da201cb8600/0x9161b78f8ec400a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec400a0 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.619421:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da201cb8600/0x9161b78f8ec400a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec400a0 expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.619435:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da201cb8600/0x9161b78f8ec400a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec400a0 expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.619448:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da201cb8600, rc 0) 00000100:00100000:0.0:1788891056.619556:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996285952:12345-0@lo:101:mount.lustre.0 Request processed in 238us (5925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891056.619563:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788891056.619680:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996285952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891056.619703:0:15733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c0031800/0x9161b78f8ec400a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400a7 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.619732:0:15733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c0031800/0x9161b78f8ec400a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec400a7 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788891056.620773:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788891056.621760:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788891056.625082:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788891056.625293:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788891056.625326:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788891056.625370:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788891056.625408:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788891056.625446:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788891056.625538:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788891056.625546:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788891056.625901:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788891056.625997:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891056.626075:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d0fafa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891056.626229:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996286080 00000100:00100000:0.0:1788891056.626238:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996286080 00000100:00100000:0.0:1788891056.626356:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788891056.626367:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996286080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788891056.626934:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996286080:12345-0@lo:501:mount.lustre.0 Request processed in 567us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891056.626955:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788891056.627003:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891056.627057:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891056.627107:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.629032:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788891056.630224:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996286208 00000100:00100000:2.0:1788891056.630240:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996286208 00000100:00100000:2.0:1788891056.630315:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788891056.630346:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996286208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891056.635369:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996286208:12345-0@lo:503:mount.lustre.0 Request processed in 5011us (8246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891056.635389:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788891056.635447:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891056.636628:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891056.636746:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891056.636824:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.636882:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788891056.637094:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996286336 00000100:00100000:1.0:1788891056.637103:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996286336 00000100:00100000:1.0:1788891056.637270:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788891056.637281:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996286336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891056.637586:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996286336:12345-0@lo:502:mount.lustre.0 Request processed in 306us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891056.637595:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788891056.637696:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891056.637985:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788891056.638043:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788891056.638090:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788891056.638140:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788891056.638209:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788891056.638240:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788891056.638280:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788891056.638315:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788891056.638361:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788891056.638404:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891056.638469:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.638912:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788891056.639041:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996286464 00000100:00100000:0.0:1788891056.639057:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996286464 00000100:00100000:0.0:1788891056.639101:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788891056.639111:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996286464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891056.639352:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996286464:12345-0@lo:502:mount.lustre.0 Request processed in 242us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891056.639361:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788891056.639529:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891056.639620:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788891056.639636:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788891056.640712:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788891056.640724:0:15735:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788891056.640731:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891056.640734:0:15735:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788891056.640743:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788891056.640775:0:15735:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9da1f50a8000) 00000020:00000080:3.0:1788891056.640805:0:15735:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788891056.640813:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788891056.640899:0:15735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da1ffeb9000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788891056.640908:0:15735:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788891056.640916:0:15735:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9161b78f8ec400b5 00010000:00010000:3.0:1788891056.644743:0:15735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788891056.645443:0:15735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788891056.647132:0:15735:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788891056.648918:0:15735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788891056.648933:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891056.648950:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891056.648953:0:15735:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788891056.648957:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891056.648961:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891056.648963:0:15735:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788891056.648966:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788891056.648968:0:15735:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788891056.648970:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891056.648972:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891056.648973:0:15735:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788891056.648976:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788891056.648978:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891056.648979:0:15735:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788891056.648987:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788891056.649052:0:15735:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788891056.649055:0:15735:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788891056.649056:0:15735:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788891056.649059:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788891056.649283:0:15733:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788891056.649405:0:15733:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788891056.649433:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031800/0x9161b78f8ec400a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400a7 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.649447:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c0031800/0x9161b78f8ec400a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400a7 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788891056.649457:0:15733:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1ffeb9000 from 1 10000000:01000000:0.0:1788891056.649460:0:15733:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788891056.649506:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.649515:0:15733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.649528:0:15733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891056.649562:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788891056.649652:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891056.649789:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c55b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788891056.650384:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996286592 00000100:00100000:1.0:1788891056.650395:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996286592 00000100:00100000:1.0:1788891056.650493:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788891056.650505:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:15733:x1875787996286592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891056.650523:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891056.650541:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec400bc expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.650571:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec400bc expref: 18 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.650581:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec400bc expref: 18 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.650590:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6fa00, rc 0) 00000100:00100000:1.0:1788891056.650657:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996286592:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891056.650664:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788891056.652589:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891056.652624:0:15733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.652637:0:15733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891056.653324:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788891056.656704:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891056.657152:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788891056.657264:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788891056.660622:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788891056.660652:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788891056.660806:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891056.660893:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.660997:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2aef300 going to sleep for 11 seconds 00000100:00100000:2.0:1788891056.661049:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996286720 00000100:00100000:2.0:1788891056.661059:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996286720 00000100:00100000:2.0:1788891056.661152:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788891056.661165:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996286720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788891056.661661:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996286720:12345-0@lo:501:mount.lustre.0 Request processed in 496us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891056.661672:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788891056.661767:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891056.661818:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891056.661877:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.662142:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2aef300 going to sleep for 11 seconds 00000100:00100000:0.0:1788891056.662383:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996286848 00000100:00100000:0.0:1788891056.662404:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996286848 00000100:00100000:0.0:1788891056.662448:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788891056.662459:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996286848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788891056.662946:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996286848:12345-0@lo:503:mount.lustre.0 Request processed in 476us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891056.662954:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788891056.663075:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891056.663918:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891056.664031:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891056.664114:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.664257:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2aef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891056.665832:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996286976 00000100:00100000:1.0:1788891056.665850:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996286976 00000100:00100000:2.0:1788891056.666018:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788891056.666034:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996286976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788891056.666480:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996286976:12345-0@lo:502:mount.lustre.0 Request processed in 448us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891056.666490:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788891056.666773:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996286976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891056.667144:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788891056.667280:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788891056.667406:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788891056.667446:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788891056.667479:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788891056.667527:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788891056.667562:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788891056.667594:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788891056.667641:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891056.667709:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.667753:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2aef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788891056.668264:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996287104 00000100:00100000:1.0:1788891056.668282:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996287104 00000100:00100000:1.0:1788891056.668336:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788891056.668346:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996287104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788891056.668586:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996287104:12345-0@lo:502:mount.lustre.0 Request processed in 241us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891056.668595:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788891056.668975:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891056.669123:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788891056.669140:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788891056.673796:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891056.673816:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891056.673819:0:15739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788891056.673829:0:15739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1ffeb9000 00000020:00000080:2.0:1788891056.673833:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891056.673842:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891056.673845:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891056.673846:0:15739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788891056.673848:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891056.673851:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891056.673852:0:15739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788891056.673855:0:15739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9da1ffeb9000 00000020:00000080:2.0:1788891056.673869:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891056.674004:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891056.674009:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891056.674010:0:15739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788891056.674014:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788891056.674017:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891056.674018:0:15739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788891056.674022:0:15739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9da1ffeb9000 00000020:00000080:2.0:1788891056.674024:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788891056.675479:0:15739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788891056.675492:0:15739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788891056.675495:0:15739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788891056.675500:0:15739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788891056.675747:0:15733:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788891056.675781:0:15733:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788891056.675810:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.675825:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788891056.675882:0:15733:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788891056.675887:0:15733:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9da1ffeb9000 10000000:01000000:3.0:1788891056.675891:0:15733:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9da1ffeb9000 10000000:01000000:3.0:1788891056.675907:0:15733:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788891056.675915:0:15733:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9da1ffeb9000 from 1 10000000:01000000:3.0:1788891056.675918:0:15733:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788891056.675979:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031c00/0x9161b78f8ec400ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.675989:0:15733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c0031c00/0x9161b78f8ec400ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.676005:0:15733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c0031c00/0x9161b78f8ec400ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891056.676036:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788891056.676149:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.676228:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2aef0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891056.676474:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996287232 00000100:00100000:1.0:1788891056.676485:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996287232 00000100:00100000:1.0:1788891056.676548:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788891056.676561:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c1191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996287232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788891056.676579:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891056.676598:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec400d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec400ca expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.676626:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec400d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec400ca expref: 19 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.676639:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6f200/0x9161b78f8ec400d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec400ca expref: 19 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.676649:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6f200, rc 0) 00000100:00100000:1.0:1788891056.676700:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c1191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996287232:12345-0@lo:101:mount.lustre.0 Request processed in 142us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891056.676708:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788891056.676833:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788891056.676850:0:15733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c0031c00/0x9161b78f8ec400ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400d1 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.676860:0:15733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c0031c00/0x9161b78f8ec400ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec400d1 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788891056.678867:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788891056.679644:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788891056.679984:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788891056.680028:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788891056.680057:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788891056.680098:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788891056.680134:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788891056.680246:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788891056.680295:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788891056.680339:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788891056.680382:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788891056.682596:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788891056.682652:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788891056.682740:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788891056.682783:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788891056.682841:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788891056.682896:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788891056.682948:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788891056.682988:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788891056.683042:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788891056.683081:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788891056.683118:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788891056.683215:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788891056.683258:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788891056.683293:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788891056.685620:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788891056.685678:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788891056.685718:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788891056.685772:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788891056.685814:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788891056.685850:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788891056.685926:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788891056.685978:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788891056.686015:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788891056.686050:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788891056.686098:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788891056.686135:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788891056.686216:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788891056.686282:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788891056.688948:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788891056.688973:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788891056.689135:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891056.689243:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.689307:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996287360 00000100:00100000:3.0:1788891056.689315:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996287360 00000100:00100000:3.0:1788891056.689373:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788891056.689384:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996287360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891056.689798:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996287360:12345-0@lo:501:mount.lustre.0 Request processed in 415us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891056.689807:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788891056.689864:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2aef0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891056.689891:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788891056.689944:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788891056.689992:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.690018:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2aef0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788891056.690403:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996287488 00000100:00100000:2.0:1788891056.690410:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996287488 00000100:00100000:2.0:1788891056.690451:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788891056.690460:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996287488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788891056.690811:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996287488:12345-0@lo:503:mount.lustre.0 Request processed in 352us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891056.690819:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788891056.693519:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287488:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788891056.696571:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788891056.696708:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891056.696823:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.696896:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996287616 00000100:00100000:3.0:1788891056.696905:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996287616 00000100:00100000:3.0:1788891056.696972:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788891056.696982:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996287616:12345-0@lo:502:mount.lustre.0 00010000:00010000:2.0:1788891056.697432:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891056.698616:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996287616:12345-0@lo:502:mount.lustre.0 Request processed in 1626us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891056.698631:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788891056.698737:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2aef0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891056.698769:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891056.699160:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788891056.699266:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788891056.702688:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788891056.702860:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788891056.702925:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788891056.702991:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788891056.703024:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788891056.703053:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788891056.703101:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788891056.703139:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788891056.703210:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788891056.703260:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788891056.703297:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788891056.705569:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788891056.705670:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788891056.705705:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788891056.705737:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788891056.705785:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788891056.705822:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788891056.705858:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788891056.705932:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788891056.705984:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788891056.706014:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788891056.706059:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788891056.706091:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788891056.706123:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788891056.706207:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788891056.706244:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788891056.706273:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788891056.708550:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788891056.708659:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788891056.708697:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788891056.708732:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788891056.708794:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788891056.708830:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788891056.708874:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788891056.708924:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788891056.708977:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788891056.709039:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788891056.709079:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788891056.709150:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788891056.709354:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.709411:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c2aef0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891056.709591:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996287744 00000100:00100000:0.0:1788891056.709602:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996287744 00000100:00100000:0.0:1788891056.709670:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788891056.709682:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996287744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788891056.709982:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996287744:12345-0@lo:502:mount.lustre.0 Request processed in 302us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891056.709992:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788891056.712478:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996287744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788891056.712672:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788891056.712694:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788891056.716945:0:15744:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788891056.716982:0:15744:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9da1f4b3b370) 00000020:00000080:1.0:1788891056.717012:0:15744:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788891056.717108:0:15744:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9da1ffeb9000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788891056.717113:0:15744:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9da1ffeb9000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788891056.717121:0:15744:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9da1ffeb9000 3 00010000:00080000:1.0:1788891056.717161:0:15744:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9da1cae1b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.118@tcp at head 00010000:00010000:0.0:1788891056.721428:0:15744:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788891056.721651:0:15744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788891056.721720:0:15744:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788891056.721735:0:15744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9161b78f8ec400df 00000100:00080000:0.0:1788891056.721749:0:15744:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788891056.721757:0:15744:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9da1cae1b000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:0.0:1788891056.721805:0:15744:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da201f8ed80 x1875787996287872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891056.721848:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1875787996287872:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788891056.721951:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891056.722039:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996287872 00000100:00100000:0.0:1788891056.722047:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996287872 00000100:00100000:0.0:1788891056.722233:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788891056.722242:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3278:x1875787996287872:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788891056.722278:0:14337:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:0.0:1788891056.722320:0:14337:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9161b78f8ec400e6 00000004:00100000:0.0:1788891056.722339:0:14337:0:(mdt_handler.c:7308:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788891056.722385:0:14337:0:(import.c:65:import_set_state_nolock()) ffff9da1d0e49800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891056.722447:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875787996287872:12345-0@lo:38:llog_process_th.0 Request processed in 205us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891056.722455:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788891056.722510:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f8ed80 x1875787996287872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788891066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788891056.722521:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788891056.722530:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788891056.722538:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788891056.722543:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788891056.722546:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1cae1b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788891056.722553:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1875787996287872:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788891056.722574:0:15744:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788891056.722647:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788891056.722653:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788891056.722655:0:38:0:(import.c:65:import_set_state_nolock()) ffff9da1f0238000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788891056.722660:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 276 00000100:00080000:2.0:1788891056.722663:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788891056.722668:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9da1f0238000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:2.0:1788891056.722683:0:38:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da1f52c1500 x1875787996288128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788891056.722758:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788891056.722769:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996288000:0@lo:400:kworker.0 00000100:00100000:2.0:1788891056.722810:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891056.723031:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996288128:0@lo:8:kworker.0 00000100:00100000:0.0:1788891056.723062:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.724575:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996288256:0@lo:400:kworker.0 00000100:00100000:3.0:1788891056.724652:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.724700:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788891056.724708:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996288384:0@lo:400:kworker.0 00000100:00100000:3.0:1788891056.724734:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.724781:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996288000 00000100:00100000:3.0:1788891056.724791:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996288000 00000100:00100000:3.0:1788891056.724860:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996288128 00000100:00100000:3.0:1788891056.724864:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996288128 00000100:00100000:3.0:1788891056.724885:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891056.724896:0:15020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996288000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891056.724971:0:15020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996288000:12345-0@lo:400:kworker.0 Request processed in 77us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891056.724984:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788891056.725003:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891056.725007:0:15020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3278:x1875787996288128:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788891056.725059:0:15020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3278:x1875787996288128:12345-0@lo:8:kworker.0 Request processed in 50us (1996us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788891056.725066:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891056.725088:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996288256 00000100:00100000:3.0:1788891056.725092:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996288256 00000100:00100000:3.0:1788891056.725117:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996288384 00000100:00100000:3.0:1788891056.725120:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996288384 00000100:00100000:3.0:1788891056.725139:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891056.725145:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996288256:12345-0@lo:400:kworker.0 00000040:00080000:0.0:1788891056.726634:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:2.0:1788891056.727893:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788891056.727902:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891056.728010:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996288000:0@lo:400:kworker.0 00000100:00100000:2.0:1788891056.728066:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788891056.728075:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788891056.728443:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875787996288256:12345-0@lo:400:kworker.0 Request processed in 67us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891056.728455:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891056.728488:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788891056.728503:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996288384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891056.728603:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875787996288384:12345-0@lo:400:kworker.0 Request processed in 106us (3868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891056.728609:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:3.0:1788891056.728637:0:15733:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788891056.728682:0:15733:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788891056.728742:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c0031c00/0x9161b78f8ec400ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400d1 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.728756:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c0031c00/0x9161b78f8ec400ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400d1 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788891056.728824:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788891056.728827:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788891056.728829:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891056.728830:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891056.728831:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891056.728833:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891056.728835:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891056.728837:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891056.728839:0:15733:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788891056.728844:0:15733:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788891056.728847:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788891056.728848:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788891056.728850:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788891056.728851:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788891056.728852:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788891056.728853:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788891056.728854:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788891056.728855:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788891056.728856:0:15733:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788891056.728887:0:15733:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788891056.728908:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996288512:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788891056.728973:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891056.729010:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788891056.729030:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996288512 00000100:00100000:3.0:1788891056.729037:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996288512 00000100:00100000:3.0:1788891056.729091:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788891056.729098:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:15733:x1875787996288512:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788891056.729125:0:14331:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788891056.729142:0:14331:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788891056.730929:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f52c2d80 x1875787996288384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891056.730966:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1875787996288384:0@lo:400:kworker.0 00010000:00080000:3.0:1788891056.731000:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da1f52c0a80 x1875787996288256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891056.731010:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875787996288256:0@lo:400:kworker.0 00000100:00100000:3.0:1788891056.731067:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788891056.731075:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f0238000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788891056.731080:0:3278:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788891056.731089:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996288128:0@lo:8:kworker.0 20000000:01000000:2.0:1788891056.761103:0:14331:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788891056.761129:0:14331:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788891056.761279:0:14352:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788891056.761290:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788891056.761313:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.761335:0:14352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec40084 expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.761364:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.761407:0:14352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec40084 expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.761421:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec40084 expref: 19 pid: 14329 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891056.761436:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14352:1875787996288640:0@lo:104: 00000100:00100000:0.0:1788891056.761500:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891056.761549:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d13d1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891056.761720:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996288640 00000100:00100000:3.0:1788891056.761729:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996288640 00000100:00100000:3.0:1788891056.761781:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788891056.761793:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:14352:x1875787996288640:12345-0@lo:104: 00010000:00010000:3.0:1788891056.761809:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891056.761890:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788891056.761897:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:14352:x1875787996288640:12345-0@lo:104: Request processed in 107us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891056.761906:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788891056.761945:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14352:1875787996288640:0@lo:104: 00010000:00010000:0.0:1788891056.761975:0:14352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891056.762451:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891056.762459:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891056.762469:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e600 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:2.0:1788891056.762473:0:14325:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891056.762482:0:14325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788891056.762490:0:14325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891056.762496:0:14325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788891056.762531:0:14325:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891056.762538:0:14325:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788891056.762596:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891056.762603:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6e600/0x9161b78f8ec40084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec4008b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891056.762668:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891056.762671:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891056.762672:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891056.762793:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996288768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788891056.763066:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891056.763303:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996288768 00000100:00100000:1.0:1788891056.763313:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996288768 00010000:00010000:1.0:1788891056.763348:0:14321:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec40084 expref: 20 pid: 14329 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891056.763388:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788891056.763398:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+20:3281:x1875787996288768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891056.763416:0:14321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891056.763427:0:14321:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec40084 expref: 20 pid: 14329 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763441:0:14321:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec40084 expref: 20 pid: 14329 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763459:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c9c86c00/0x9161b78f8ec4008b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec40084 expref: 20 pid: 14329 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763479:0:14321:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763489:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788891056.763510:0:14321:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002221327s 00010000:00010000:1.0:1788891056.763516:0:14321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763537:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763562:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763569:0:14321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763576:0:14321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788891056.763581:0:14321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763591:0:14321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763609:0:14321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891056.763622:0:14321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891056.763701:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:3281:x1875787996288768:12345-0@lo:103:ldlm_bl.0 Request processed in 303us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891056.763710:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788891056.763722:0:14352:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.763921:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891056.763943:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da201cb8200/0x9161b78f8ec400ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891056.764104:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996288768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788891056.780046:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:15733:x1875787996288512:12345-0@lo:253:mount.lustre.0 Request processed in 50934us (51058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891056.780065:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788891056.780209:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73a29ebe-4d40-4a82-b77a-4b1222504c0e:15733:1875787996288512:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788891056.780254:0:15733:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788891056.780259:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788891056.780261:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788891056.780262:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788891056.780264:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788891056.780265:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788891056.780267:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788891056.780269:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788891056.780272:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788891056.780274:0:15733:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788891056.780295:0:15733:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788891056.785495:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788891056.785723:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788891056.785900:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788891056.786068:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788891056.786255:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788891056.786471:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788891056.787520:0:15733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788891056.840143:0:15733:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788891056.840155:0:15733:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788891056.840220:0:15733:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788891056.840292:0:15733:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788891056.840373:0:15733:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788891056.840403:0:15733:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788891057.719010:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891058.230454:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996288896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891058.230529:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891058.230662:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996288896 00000100:00100000:2.0:1788891058.230671:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996288896 00000100:00080000:0.0:1788891058.230714:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891058.230773:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891058.230783:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996288896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788891058.230817:0:15022:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788891058.230877:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996288896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891058.230884:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788891058.231044:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996288896:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1788891058.359601:0:14333:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788891058.359610:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9da0c1acc000 from 8 10000000:01000000:0.0:1788891058.359615:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788891058.359658:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9800/0x9161b78f8ec400f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891058.359692:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da201cb9800/0x9161b78f8ec400f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891058.359705:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da201cb9800/0x9161b78f8ec400f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891058.359731:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996289024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788891058.360247:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891058.361472:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201c54cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788891058.361683:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996289024 00000100:00100000:3.0:1788891058.361691:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996289024 00000100:00100000:3.0:1788891058.361777:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788891058.361788:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1ffc2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:14333:x1875787996289024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891058.361804:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891058.361828:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0031a00/0x9161b78f8ec400fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec400f4 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891058.361852:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0031a00/0x9161b78f8ec400fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec400f4 expref: 19 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891058.361864:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0031a00/0x9161b78f8ec400fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec400f4 expref: 19 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891058.361874:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031a00, rc 0) 00000100:00100000:3.0:1788891058.361942:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1ffc2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:14333:x1875787996289024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891058.361949:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788891058.362027:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996289024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891058.362043:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da201cb9800/0x9161b78f8ec400f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400fb expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891058.362051:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da201cb9800/0x9161b78f8ec400f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec400fb expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891058.362120:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996289152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788891058.362154:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891058.364300:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da201c54cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891058.366720:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996289152 00000100:00100000:1.0:1788891058.366731:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996289152 00000100:00100000:1.0:1788891058.366790:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788891058.366800:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:14333:x1875787996289152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788891058.366831:0:14329:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788891058.366845:0:14329:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788891058.366851:0:14329:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788891058.366988:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:14333:x1875787996289152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 188us (4833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891058.366995:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788891058.367161:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996289152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788891058.367251:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788891058.367261:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da201cb9800/0x9161b78f8ec400f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400fb expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891058.367273:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da201cb9800/0x9161b78f8ec400f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec400fb expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891058.742736:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891059.766514:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891060.791925:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788891060.895886:0:16089:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg418-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1788891060.985431:0:14371:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788891060.985440:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891060.985552:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1788891060.985559:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788891061.814354:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788891061.814519:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788891061.814524:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788891061.814533:0:38:0:(import.c:65:import_set_state_nolock()) ffff9da1f0238000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788891061.814548:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9da1f0238000 using connection 192.168.204.118@tcp/0@lo 00000100:00100000:0.0:1788891061.814573:0:38:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9da201f8ca80 x1875787996289536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788891061.814761:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996289664:0@lo:400:kworker.0 00000100:00100000:0.0:1788891061.814825:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891061.814928:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996289536:0@lo:8:kworker.0 00000100:00100000:0.0:1788891061.815963:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788891061.815973:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996289792:0@lo:400:kworker.0 00000100:00100000:0.0:1788891061.816730:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891061.816849:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891061.817231:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996289536 00000100:00100000:0.0:1788891061.817239:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996289536 00000100:00100000:0.0:1788891061.817283:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788891061.817291:0:15020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3278:x1875787996289536:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788891061.817323:0:15020:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:0.0:1788891061.817357:0:15020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9161b78f8ec40102 00002000:00100000:0.0:1788891061.817371:0:15020:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9da1f4b0a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788891061.817376:0:15020:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788891061.817379:0:15020:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788891061.817813:0:15020:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788891061.817860:0:15020:0:(import.c:65:import_set_state_nolock()) ffff9da1f4b0d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891061.817932:0:15020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1875787996289536:12345-0@lo:8:kworker.0 Request processed in 639us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891061.817941:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788891061.817993:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f8ca80 x1875787996289536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788891086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788891061.818009:0:3278:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788891061.818016:0:3278:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788891061.818020:0:3278:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788891061.818023:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9da1f0238000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788891061.818038:0:3278:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788891061.818043:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1875787996289536:0@lo:8:kworker.0 00000004:00080000:0.0:1788891061.818087:0:14361:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788891061.818106:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14361:1875787996290176:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788891061.818142:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891061.818190:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891061.818212:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996290176 00000100:00100000:0.0:1788891061.818217:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996290176 00000100:00100000:0.0:1788891061.818266:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891061.818276:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14361:x1875787996290176:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788891061.819185:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996289280:0@lo:400:kworker.0 00000100:00100000:3.0:1788891061.819238:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891061.819283:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996289920:0@lo:400:kworker.0 00000100:00100000:3.0:1788891061.819319:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891061.819348:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788891061.819356:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996289408:0@lo:400:kworker.0 00000100:00100000:3.0:1788891061.819390:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891061.819413:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788891061.819441:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891061.819683:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996289664 00000100:00100000:3.0:1788891061.819690:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996289664 00000100:00100000:3.0:1788891061.819733:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996289792 00000100:00100000:3.0:1788891061.819737:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996289792 00000100:00100000:3.0:1788891061.819764:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996289920 00000100:00100000:3.0:1788891061.819767:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996289920 00000100:00100000:3.0:1788891061.819792:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788891061.819811:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996289664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891061.819882:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875787996289664:12345-0@lo:400:kworker.0 Request processed in 73us (5058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891061.819890:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788891061.819911:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891061.819919:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996289792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891061.819944:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996289408 00000100:00100000:3.0:1788891061.819950:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875787996289792:12345-0@lo:400:kworker.0 Request processed in 33us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891061.819951:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996289408 00000100:00100000:1.0:1788891061.819952:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996290048 00000100:00100000:1.0:1788891061.819958:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996290048 00000100:00100000:3.0:1788891061.819959:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891061.819971:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788891061.819977:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891061.819992:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891061.819997:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788891061.820005:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996289408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891061.820071:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875787996290048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788891061.820160:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788891061.820700:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996289408:12345-0@lo:400:kworker.0 Request processed in 697us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891061.820709:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891061.820767:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875787996290048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 761us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891061.820775:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788891061.820997:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788891061.821005:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788891061.821008:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788891061.821076:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f8dc00 x1875787996289792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891061.821101:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1875787996289792:0@lo:400:kworker.0 00010000:00080000:1.0:1788891061.821117:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f8ce00 x1875787996289664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788891061.821127:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875787996289664:0@lo:400:kworker.0 00000100:00100000:1.0:1788891061.821230:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996289280 00000100:00100000:1.0:1788891061.821235:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996289280 00000100:00100000:1.0:1788891061.821281:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788891061.821290:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:3279:x1875787996289280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891061.821337:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:3279:x1875787996289280:12345-0@lo:400:kworker.0 Request processed in 48us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891061.821344:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:1.0:1788891061.821380:0:14360:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788891061.821781:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996289920:12345-0@lo:400:kworker.0 Request processed in 1802us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891061.821789:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788891061.821827:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996289408:0@lo:400:kworker.0 00010000:00080000:3.0:1788891061.821857:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f8ca80 x1875787996290048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788891077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891061.821873:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788891061.821882:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996289280:0@lo:400:kworker.0 00010000:00080000:3.0:1788891061.821891:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9da201f8f100 x1875787996289920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788891077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788891061.821899:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996289920:0@lo:400:kworker.0 00000004:00080000:1.0:1788891061.822369:0:14360:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 285671199433ns, next at 0ns, rc = 0 00002000:00080000:0.0:1788891061.822524:0:15018:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788891061.822531:0:15018:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788891061.822536:0:15018:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788891061.837499:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.837511:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.837542:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.837546:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.837553:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.837571:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.837581:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.837588:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.837612:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788891061.837687:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891061.837695:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.837704:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788891061.837709:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.837719:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.837738:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.837744:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009ba0245/0x9161b78f8ec40109 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.837759:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891061.837761:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891061.837763:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.838461:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.838467:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838476:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.838480:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.838485:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838495:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838514:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838521:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838535:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891061.838543:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891061.838548:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838555:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8000 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788891061.838558:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838566:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838577:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838585:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37f12ad/0x9161b78f8ec40110 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.838597:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.838604:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.838605:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.839442:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.839450:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839459:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.839586:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.839592:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839602:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839610:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839618:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839634:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891061.839644:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891061.839713:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839721:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9e00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788891061.839725:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839750:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839763:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839771:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056c5c4a9/0x9161b78f8ec40117 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.839785:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.839786:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.839788:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.840924:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.840933:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.840946:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.840950:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.840956:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.840967:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.840976:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.840990:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.841005:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891061.841742:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891061.841750:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.841759:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9000 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788891061.841763:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.841772:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.841790:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.841797:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047599620/0x9161b78f8ec4011e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.841813:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.841815:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.841817:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.843266:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.843283:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.843297:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.843301:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.843307:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.843319:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.843329:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.843337:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.843351:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891061.844403:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.844411:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.844422:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.844426:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.844430:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.844440:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.844454:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.844461:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.844483:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788891061.844503:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891061.844511:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844519:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8a00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788891061.844524:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844533:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844549:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844556:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000440ffd4a/0x9161b78f8ec40125 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844573:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891061.844576:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844582:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05a00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788891061.844586:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844593:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844615:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844623:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec4012c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891061.844635:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891061.844637:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891061.844639:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.846156:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.846293:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.846301:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.846313:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.846317:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.846323:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.846334:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.846344:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.846351:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.846391:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891061.846584:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891061.846602:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.846614:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05e00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891061.846619:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.846630:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.846652:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.846659:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec40133 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.846709:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.846712:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.846714:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.847522:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.847530:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.847541:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.847544:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.847549:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.847559:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.847567:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.847574:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.847592:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891061.848500:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.848506:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.848515:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.848525:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.848531:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.848541:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.848549:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.848556:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.848888:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788891061.849448:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788891061.849456:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788891061.849456:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.849467:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=285s v=(0 0) 00010000:00010000:3.0:1788891061.849472:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.849472:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.849483:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849488:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891061.849496:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.849499:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.849511:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.849525:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.849534:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788891061.849569:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849593:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849601:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec4013a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849625:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891061.849630:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849637:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891061.849649:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849658:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849684:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849691:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec40141 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849709:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891061.849712:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849718:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891061.849722:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849728:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849738:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849745:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec40148 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.849769:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.849771:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.849781:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.850930:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.850938:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.850950:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.850955:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.850961:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.850973:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.850982:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.850989:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.851012:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891061.851024:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891061.851029:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.851042:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04c00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788891061.851046:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.851859:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.851877:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.851885:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec4014f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.851901:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.851903:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.851905:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891061.852285:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.853523:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.853533:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.853549:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.853553:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.853559:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.853570:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.853584:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.853591:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.853615:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891061.853867:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891061.853874:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.853893:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891061.853897:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.853905:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.853923:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.853930:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec40156 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.853945:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.853947:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.853949:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788891061.854719:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788891061.855257:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.855265:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855278:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.855282:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.855288:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855300:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855309:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855317:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855342:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788891061.855352:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788891061.855357:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855371:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05000 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788891061.855374:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855383:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855396:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855403:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce021ea8/0x9161b78f8ec4015d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.855417:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.855418:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.855419:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.857223:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.857235:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.857250:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.857260:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.857267:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.857281:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.857291:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.857299:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.857325:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891061.857869:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891061.857877:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.857886:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891061.857890:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.857899:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.857916:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.857923:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010a00d59/0x9161b78f8ec40164 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.857938:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.857939:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.857941:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.858124:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.858131:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.858140:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.858144:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.858149:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.858159:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.858198:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.858214:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.858249:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891061.859135:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.859153:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859164:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.859191:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.859197:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859208:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859217:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859223:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859240:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788891061.859252:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788891061.859257:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859270:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788891061.859274:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859282:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859295:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859302:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000114f2cdd/0x9161b78f8ec4016b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859317:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891061.859320:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.859320:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859326:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04000 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788891061.859330:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859337:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859347:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859360:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad19195e/0x9161b78f8ec40172 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.859372:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.859373:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.859375:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.860075:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.860083:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.860093:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.860097:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.860102:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.860113:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.860121:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.860129:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.860154:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891061.860221:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891061.860228:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.860236:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05c00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891061.860240:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.860258:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.860272:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.860279:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045858de9/0x9161b78f8ec40179 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.860293:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.860294:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.860296:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788891061.860613:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788891061.861020:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.861031:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.861042:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.861046:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.861051:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.861061:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.861069:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.861076:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.861099:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891061.862027:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891061.862037:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.862047:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891061.862051:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891061.862058:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.862064:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.862067:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.862073:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.862077:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.862081:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.862083:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.862090:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ee54052/0x9161b78f8ec40180 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.862091:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.862103:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.862106:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.862108:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.862109:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.862111:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.862132:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891061.862151:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891061.862157:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.862164:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04c00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891061.862185:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.862193:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.862352:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.862371:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000464c8d16/0x9161b78f8ec40187 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.862384:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.862386:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.862387:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.863214:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.863221:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.863232:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.863235:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.863240:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.863251:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.863259:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.863266:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.863294:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788891061.863913:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891061.863921:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.863929:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04e00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891061.863932:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.863940:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.863957:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.863976:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003df8e7f/0x9161b78f8ec4018e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.864009:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.864011:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.864013:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.864655:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.864662:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.864672:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.864676:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.864681:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.864692:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.864701:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.864708:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.864771:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891061.865286:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.865292:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.865301:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.865310:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.865316:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.865326:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.865334:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.865341:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865501:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891061.865512:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865526:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04a00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891061.865530:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865539:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865558:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865565:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd94fa77/0x9161b78f8ec40195 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865585:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891061.865588:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865601:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891061.865605:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865613:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865624:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.865632:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.865632:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788891061.865635:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.865639:0:15018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000051eedd9/0x9161b78f8ec4019c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788891061.866107:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.866112:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.866121:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.866124:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.866128:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.866138:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.866155:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.866162:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.866330:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891061.866337:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.866344:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891061.866348:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.866356:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.866369:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.866377:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.866378:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.866380:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.866407:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.866886:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788891061.866892:0:15018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004600c030/0x9161b78f8ec401a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.867071:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.867607:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.867614:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.867625:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.867629:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.867635:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.867646:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.867654:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.867673:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.867694:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788891061.867722:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891061.867730:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.867739:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05e00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891061.867744:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.867752:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.867768:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.867782:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed1936b5/0x9161b78f8ec401aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.867804:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.867807:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.867809:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.868148:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.868154:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.868163:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.868320:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.868325:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.868336:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.868344:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.868351:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.868394:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891061.868785:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.868791:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.868804:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.868807:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.868812:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.868820:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.868827:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.868846:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.868907:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788891061.868915:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.868929:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05a00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891061.868933:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.868942:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.868957:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.868963:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000087ab96f/0x9161b78f8ec401b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.868979:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788891061.868982:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.868988:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891061.869002:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.869010:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.869019:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891061.869031:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.869032:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.869034:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788891061.869137:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788891061.869142:0:15018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c57552a3/0x9161b78f8ec401b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.869346:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788891061.869809:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.869815:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.869825:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.869829:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.869844:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.869866:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.869875:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.869882:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.869939:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788891061.870445:0:15018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788891061.870451:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.870460:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788891061.870464:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788891061.870468:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.870478:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.870486:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.870505:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891061.873840:0:15018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1788891061.874227:0:15018:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788891061.874322:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14361:x1875787996290176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 56044us (56177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891061.874332:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891061.874389:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14361:1875787996290176:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788891061.874404:0:14361:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788891061.874447:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14361:1875787996290304:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788891061.874480:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788891061.874569:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788891061.874578:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874590:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891061.874595:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874605:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874627:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874635:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb367acd/0x9161b78f8ec401bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874661:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788891061.874665:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874678:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891061.874681:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874689:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874700:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874707:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fd518f0/0x9161b78f8ec401c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891061.874720:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.874722:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788891061.874724:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788891061.874845:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891061.874939:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5681b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788891061.874957:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996290304 00000100:00100000:0.0:1788891061.874963:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996290304 00000100:00100000:0.0:1788891061.875035:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891061.875044:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14361:x1875787996290304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788891061.875077:0:15021:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788891061.882794:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14361:x1875787996290304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7740us (8302us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788891061.882808:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788891061.882943:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14361:1875787996290304:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788891061.882960:0:14361:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1788891062.324229:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.324393:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915136 00000100:00100000:0.0:1788891062.324402:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915136 00000100:00100000:0.0:1788891062.324449:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 72 00000100:00100000:0.0:1788891062.324458:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2371:x1875787987915136:12345-192.168.204.18@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788891062.324501:0:14329:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from fc193f55-7156-499f-9b02-e138dba3feae@192.168.204.18@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:0.0:1788891062.324527:0:14329:0:(genops.c:1385:class_connect()) connect: client fc193f55-7156-499f-9b02-e138dba3feae, cookie 0x9161b78f8ec401cd 00000100:00080000:0.0:1788891062.324670:0:14329:0:(import.c:65:import_set_state_nolock()) ffff9da1f4b09000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788891062.324792:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+5:2371:x1875787987915136:12345-192.168.204.18@tcp:250:mount.lustre.0 Request processed in 333us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891062.324801:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 72 00000100:00100000:3.0:1788891062.332628:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891062.332765:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915264 00000100:00100000:1.0:1788891062.332777:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915264 00000100:00100000:1.0:1788891062.332856:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 73 00000100:00100000:1.0:1788891062.332867:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+5:13749:x1875787987915264:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788891062.332884:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891062.332903:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec401d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2058 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891062.332932:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec401d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2058 expref: 6 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891062.332944:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1d0f6fe00/0x9161b78f8ec401d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2058 expref: 6 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891062.332954:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6fe00, rc 0) 00000100:00100000:1.0:1788891062.333026:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+6:13749:x1875787987915264:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 160us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891062.333047:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 73 00000100:00100000:2.0:1788891062.335151:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891062.335442:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915392 00000100:00100000:1.0:1788891062.335451:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915392 00000100:00100000:1.0:1788891062.335501:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 74 00000100:00100000:1.0:1788891062.335510:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+6:13749:x1875787987915392:12345-192.168.204.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788891062.335761:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+6:13749:x1875787987915392:12345-192.168.204.18@tcp:501:mount.lustre.0 Request processed in 252us (617us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788891062.335770:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 74 00000100:00100000:2.0:1788891062.338802:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.339673:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915520 00000100:00100000:0.0:1788891062.339692:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915520 00000100:00100000:0.0:1788891062.339750:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:0.0:1788891062.339763:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+6:13749:x1875787987915520:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788891062.339779:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891062.339798:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1ffc05000/0x9161b78f8ec401db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a205f expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891062.339839:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1ffc05000/0x9161b78f8ec401db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a205f expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891062.339852:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1ffc05000/0x9161b78f8ec401db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a205f expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891062.339862:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1ffc05000, rc 0) 00000100:00100000:0.0:1788891062.339918:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+7:13749:x1875787987915520:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 159us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891062.339925:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 75 00000100:00100000:3.0:1788891062.342476:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.343499:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915648 00000100:00100000:0.0:1788891062.343509:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915648 00000100:00100000:0.0:1788891062.343569:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 76 00000100:00100000:0.0:1788891062.343594:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+7:13749:x1875787987915648:12345-192.168.204.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788891062.344070:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+8:13749:x1875787987915648:12345-192.168.204.18@tcp:501:mount.lustre.0 Request processed in 476us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891062.344080:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 76 00000100:00100000:2.0:1788891062.346155:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.348448:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915776 00000100:00100000:0.0:1788891062.348462:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915776 00000100:00100000:0.0:1788891062.348515:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 77 00000100:00100000:0.0:1788891062.348524:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f6d47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+8:13749:x1875787987915776:12345-192.168.204.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788891062.348763:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f6d47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+8:13749:x1875787987915776:12345-192.168.204.18@tcp:503:mount.lustre.0 Request processed in 239us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891062.348771:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 77 00000100:00100000:1.0:1788891062.354005:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891062.354116:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987915904 00000100:00100000:2.0:1788891062.354126:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987915904 00000100:00100000:2.0:1788891062.354222:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 78 00000100:00100000:2.0:1788891062.354233:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+8:13767:x1875787987915904:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788891062.354518:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+8:13767:x1875787987915904:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 286us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891062.354527:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 78 00000100:00100000:3.0:1788891062.377305:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891062.377901:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916032 00000100:00100000:1.0:1788891062.377912:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916032 00000100:00100000:1.0:1788891062.377969:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 79 00000100:00100000:1.0:1788891062.377979:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+8:13767:x1875787987916032:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788891062.378289:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+8:13767:x1875787987916032:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 310us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891062.378296:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 79 00000100:00100000:0.0:1788891062.381430:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891062.381522:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916160 00000100:00100000:2.0:1788891062.381531:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916160 00000100:00100000:2.0:1788891062.381584:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 80 00000100:00100000:2.0:1788891062.381595:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+8:13749:x1875787987916160:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788891062.381610:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891062.381628:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c9c87000/0x9161b78f8ec401e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2089 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891062.381656:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c9c87000/0x9161b78f8ec401e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2089 expref: 9 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891062.381666:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c9c87000/0x9161b78f8ec401e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2089 expref: 9 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891062.381676:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87000, rc 0) 00000100:00100000:2.0:1788891062.381732:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+9:13749:x1875787987916160:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 139us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891062.381739:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 80 00000100:00100000:2.0:1788891062.391275:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.391784:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916288 00000100:00100000:0.0:1788891062.391796:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916288 00000100:00100000:0.0:1788891062.391861:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 81 00000100:00100000:0.0:1788891062.391872:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+9:13749:x1875787987916288:12345-192.168.204.18@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788891062.391899:0:14329:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788891062.391926:0:14329:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788891062.391930:0:14329:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788891062.391933:0:14329:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788891062.391935:0:14329:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788891062.396060:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+9:13749:x1875787987916288:12345-192.168.204.18@tcp:256:mount.lustre.0 Request processed in 4177us (4784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891062.396076:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 81 00000100:00100000:1.0:1788891062.401301:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891062.401436:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916416 00000100:00100000:3.0:1788891062.401447:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916416 00000100:00100000:3.0:1788891062.401507:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 82 00000100:00100000:3.0:1788891062.401516:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+9:13749:x1875787987916416:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788891062.401532:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891062.401551:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2090 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891062.401581:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2090 expref: 10 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891062.401594:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2090 expref: 10 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891062.401604:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031000, rc 0) 00000100:00100000:3.0:1788891062.401666:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+10:13749:x1875787987916416:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 150us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891062.401673:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 82 00000100:00100000:2.0:1788891062.403583:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.403674:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916544 00000100:00100000:0.0:1788891062.403682:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916544 00000100:00100000:0.0:1788891062.403732:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 83 00000100:00100000:0.0:1788891062.403742:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+10:13749:x1875787987916544:12345-192.168.204.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788891062.404048:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+10:13749:x1875787987916544:12345-192.168.204.18@tcp:501:mount.lustre.0 Request processed in 307us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891062.404063:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 83 00000100:00100000:0.0:1788891062.406074:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891062.406148:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916672 00000100:00100000:2.0:1788891062.406155:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916672 00000100:00100000:2.0:1788891062.406220:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 84 00000100:00100000:2.0:1788891062.406229:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+10:13749:x1875787987916672:12345-192.168.204.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788891062.406573:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+10:13749:x1875787987916672:12345-192.168.204.18@tcp:503:mount.lustre.0 Request processed in 344us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891062.406581:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 84 00000100:00100000:1.0:1788891062.414810:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891062.416497:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916800 00000100:00100000:3.0:1788891062.416580:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916800 00000100:00100000:3.0:1788891062.416709:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 85 00000100:00100000:3.0:1788891062.416720:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+10:13774:x1875787987916800:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788891062.417004:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+10:13774:x1875787987916800:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 285us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891062.417012:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 85 00000100:00100000:1.0:1788891062.422259:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891062.422398:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987916928 00000100:00100000:2.0:1788891062.422410:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987916928 00000100:00100000:2.0:1788891062.422557:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 86 00000100:00100000:2.0:1788891062.422568:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+10:13774:x1875787987916928:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788891062.422800:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+10:13774:x1875787987916928:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 234us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891062.422808:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 86 00000100:00100000:1.0:1788891062.430666:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.430901:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917056 00000100:00100000:0.0:1788891062.430911:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917056 00000100:00100000:0.0:1788891062.431666:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:0.0:1788891062.431677:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2371:x1875787987917056:12345-192.168.204.18@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788891062.431708:0:14337:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from fdb24183-3512-436a-9819-5b2ea51da239@192.168.204.18@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:0.0:1788891062.431767:0:14337:0:(genops.c:1385:class_connect()) connect: client fdb24183-3512-436a-9819-5b2ea51da239, cookie 0x9161b78f8ec401f0 00000004:00100000:0.0:1788891062.431796:0:14337:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788891062.431802:0:14337:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788891062.456614:0:14337:0:(import.c:65:import_set_state_nolock()) ffff9da2016aa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891062.456700:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+6:2371:x1875787987917056:12345-192.168.204.18@tcp:38:mount.lustre.0 Request processed in 25023us (26043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891062.456711:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:1.0:1788891062.459153:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891062.459618:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917184 00000100:00100000:3.0:1788891062.459628:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917184 00000100:00100000:3.0:1788891062.459709:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:3.0:1788891062.459720:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+6:0:x1875787987917184:12345-192.168.204.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788891062.459760:0:14338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788891062.459877:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891062.459965:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+6:0:x1875787987917184:12345-192.168.204.18@tcp:41:mount.lustre.0 Request processed in 245us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891062.459973:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:1.0:1788891062.460200:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.460549:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917312 00000100:00100000:0.0:1788891062.460555:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917312 00000100:00100000:0.0:1788891062.460590:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:0.0:1788891062.460598:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+6:13749:x1875787987917312:12345-192.168.204.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788891062.460615:0:15747:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788891062.460662:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+6:13749:x1875787987917312:12345-192.168.204.18@tcp:41:mount.lustre.0 Request processed in 65us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891062.460669:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:2.0:1788891062.463333:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891062.463489:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917440 00000100:00100000:1.0:1788891062.463498:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917440 00000100:00100000:1.0:1788891062.463606:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:1.0:1788891062.463618:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+6:13749:x1875787987917440:12345-192.168.204.18@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788891062.463700:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+6:13749:x1875787987917440:12345-192.168.204.18@tcp:40:mount.lustre.0 Request processed in 85us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891062.463708:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:1.0:1788891062.467933:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891062.468079:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.470771:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917568 00000100:00100000:1.0:1788891062.470784:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.470787:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917568 00000100:00100000:0.0:1788891062.470849:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917696 00000100:00100000:0.0:1788891062.470854:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917696 00000100:00100000:0.0:1788891062.470906:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:0.0:1788891062.470915:0:15020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2371:x1875787987917568:12345-192.168.204.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788891062.470949:0:15020:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from fdb24183-3512-436a-9819-5b2ea51da239@192.168.204.18@tcp t0 exp 0000000000000000 cur 286 last 0 00000100:00100000:1.0:1788891062.470970:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:1.0:1788891062.470978:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875787987917696:12345-192.168.204.18@tcp:8:mount.lustre.0 00000020:00000080:0.0:1788891062.470988:0:15020:0:(genops.c:1385:class_connect()) connect: client fdb24183-3512-436a-9819-5b2ea51da239, cookie 0x9161b78f8ec401f7 00002000:00100000:0.0:1788891062.471001:0:15020:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdb24183-3512-436a-9819-5b2ea51da239/ffff9da1f4b0f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788891062.471025:0:15020:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:1.0:1788891062.471291:0:15021:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from fdb24183-3512-436a-9819-5b2ea51da239@192.168.204.18@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:1.0:1788891062.471315:0:15021:0:(genops.c:1385:class_connect()) connect: client fdb24183-3512-436a-9819-5b2ea51da239, cookie 0x9161b78f8ec401fe 00002000:00100000:1.0:1788891062.471322:0:15021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fdb24183-3512-436a-9819-5b2ea51da239/ffff9da1cae1b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788891062.471330:0:15021:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788891062.471514:0:15020:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:1.0:1788891062.471539:0:15021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788891062.471561:0:15021:0:(import.c:65:import_set_state_nolock()) ffff9da1cae19800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788891062.471562:0:15020:0:(import.c:65:import_set_state_nolock()) ffff9da1f4b0b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788891062.471644:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdb24183-3512-436a-9819-5b2ea51da239+6:2371:x1875787987917696:12345-192.168.204.18@tcp:8:mount.lustre.0 Request processed in 664us (3563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891062.471653:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:3.0:1788891062.471685:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917824 00000100:00100000:3.0:1788891062.471692:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917824 00000100:00100000:3.0:1788891062.471736:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:3.0:1788891062.471745:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdb24183-3512-436a-9819-5b2ea51da239+6:13749:x1875787987917824:12345-192.168.204.18@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788891062.472355:0:15020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdb24183-3512-436a-9819-5b2ea51da239+6:2371:x1875787987917568:12345-192.168.204.18@tcp:8:mount.lustre.0 Request processed in 1438us (4430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891062.472363:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000004:00080000:0.0:1788891062.472779:0:14339:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 975us 00000004:00200000:3.0:1788891062.484790:0:14339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788891062.484935:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdb24183-3512-436a-9819-5b2ea51da239+6:13749:x1875787987917824:12345-192.168.204.18@tcp:33:mount.lustre.0 Request processed in 13185us (14149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891062.484946:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:1.0:1788891062.605754:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891062.605859:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987917952 00000100:00100000:0.0:1788891062.605870:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987917952 00000100:00100000:0.0:1788891062.605980:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:0.0:1788891062.605991:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+6:13795:x1875787987917952:12345-192.168.204.18@tcp:101:mkdir.0 00010000:00010000:0.0:1788891062.606010:0:15747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891062.606037:0:15747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05400/0x9161b78f8ec40205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a20ba expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891062.606112:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4020c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891062.606125:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4020c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891062.606139:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4020c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891062.606211:0:15747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788891062.606227:0:15747:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788891062.606269:0:15747:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4020c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891062.606295:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05400/0x9161b78f8ec40205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20ba expref: 8 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891062.606314:0:15747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4020c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20ba expref: 7 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891062.606323:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c9a55700) 00010000:00010000:0.0:1788891062.606325:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788891062.606329:0:15747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1ffc05200, rc 0) 00000100:00100000:0.0:1788891062.606395:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+7:13795:x1875787987917952:12345-192.168.204.18@tcp:101:mkdir.0 Request processed in 407us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891062.606402:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 8 00010000:00010000:1.0:1788891062.842306:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788891062.877853:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdb24183-3512-436a-9819-5b2ea51da239 00000100:00100000:1.0:1788891063.350468:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996290432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891063.350565:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891063.350601:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996290432 00000100:00100000:3.0:1788891063.350610:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996290432 00000100:00100000:3.0:1788891063.350729:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788891063.350738:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996290432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788891063.350767:0:15022:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788891063.350836:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996290432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891063.350844:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788891063.351249:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891063.351377:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996290432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788891063.862566:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891064.329985:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891064.330115:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918080 00000100:00100000:0.0:1788891064.330124:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918080 00000100:00080000:1.0:1788891064.330192:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788891064.330244:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:0.0:1788891064.330256:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+7:13847:x1875787987918080:12345-192.168.204.18@tcp:41:lfs.0 00000004:00000024:0.0:1788891064.330349:0:14338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788891064.330622:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+7:13847:x1875787987918080:12345-192.168.204.18@tcp:41:lfs.0 Request processed in 368us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891064.330630:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:2.0:1788891064.341457:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891064.341841:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918208 00000100:00100000:3.0:1788891064.341851:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918208 00000100:00100000:3.0:1788891064.341928:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:3.0:1788891064.341938:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdb24183-3512-436a-9819-5b2ea51da239+5:13847:x1875787987918208:12345-192.168.204.18@tcp:13:lfs.0 00002000:00000024:3.0:1788891064.341983:0:15022:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788891064.342069:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdb24183-3512-436a-9819-5b2ea51da239+5:13847:x1875787987918208:12345-192.168.204.18@tcp:13:lfs.0 Request processed in 133us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.342076:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00080000:1.0:1788891064.342238:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788891064.348236:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891064.348492:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918336 00000100:00100000:3.0:1788891064.348502:0:15022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918336 00000100:00100000:3.0:1788891064.348591:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:3.0:1788891064.348602:0:15022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdb24183-3512-436a-9819-5b2ea51da239+6:13847:x1875787987918336:12345-192.168.204.18@tcp:13:lfs.0 00002000:00000024:3.0:1788891064.348641:0:15022:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788891064.348738:0:15022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdb24183-3512-436a-9819-5b2ea51da239+6:13847:x1875787987918336:12345-192.168.204.18@tcp:13:lfs.0 Request processed in 138us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.348951:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00080000:1.0:1788891064.350316:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788891064.500383:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891064.500513:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918464 00000100:00100000:3.0:1788891064.500523:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918464 00000100:00100000:3.0:1788891064.500584:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 87 00000100:00100000:3.0:1788891064.500593:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+10:13881:x1875787987918464:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788891064.500626:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891064.500655:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0030e00/0x9161b78f8ec40213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a20c1 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891064.500683:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030e00/0x9161b78f8ec40213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20c1 expref: 11 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891064.500806:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0030e00/0x9161b78f8ec40213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20c1 expref: 11 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891064.500822:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030e00, rc 0) 00000100:00100000:3.0:1788891064.500996:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+11:13881:x1875787987918464:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 402us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.501003:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 87 00000100:00100000:0.0:1788891064.505894:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891064.506685:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918592 00000100:00100000:2.0:1788891064.506697:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918592 00000100:00100000:2.0:1788891064.506757:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 88 00000100:00100000:2.0:1788891064.506767:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+11:13881:x1875787987918592:12345-192.168.204.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788891064.507054:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+11:13881:x1875787987918592:12345-192.168.204.18@tcp:501:mount.lustre.0 Request processed in 287us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891064.507062:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 88 00000100:00100000:1.0:1788891064.513554:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891064.515231:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918720 00000100:00100000:3.0:1788891064.515245:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918720 00000100:00100000:3.0:1788891064.515313:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 89 00000100:00100000:3.0:1788891064.515324:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+11:13881:x1875787987918720:12345-192.168.204.18@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788891064.515630:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+11:13881:x1875787987918720:12345-192.168.204.18@tcp:503:mount.lustre.0 Request processed in 308us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.515638:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 89 00000100:00100000:3.0:1788891064.522995:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891064.523542:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918848 00000100:00100000:0.0:1788891064.523565:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918848 00000100:00100000:0.0:1788891064.525119:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 90 00000100:00100000:0.0:1788891064.525148:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+11:13886:x1875787987918848:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788891064.525450:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+11:13886:x1875787987918848:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 318us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891064.525458:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 90 00000100:00100000:0.0:1788891064.538817:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891064.538926:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987918976 00000100:00100000:3.0:1788891064.538936:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987918976 00000100:00100000:3.0:1788891064.539004:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 91 00000100:00100000:3.0:1788891064.539014:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+11:13886:x1875787987918976:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788891064.539436:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+11:13886:x1875787987918976:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 422us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.539447:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 91 00000100:00100000:1.0:1788891064.548592:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891064.548841:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919104 00000100:00100000:0.0:1788891064.548851:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919104 00000100:00100000:0.0:1788891064.548962:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 92 00000100:00100000:0.0:1788891064.548972:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+11:13881:x1875787987919104:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788891064.548988:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891064.549017:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1ffc05e00/0x9161b78f8ec4021a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a20eb expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891064.549044:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1ffc05e00/0x9161b78f8ec4021a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20eb expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891064.549056:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1ffc05e00/0x9161b78f8ec4021a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20eb expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891064.549065:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1ffc05e00, rc 0) 00000100:00100000:0.0:1788891064.549126:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+12:13881:x1875787987919104:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 155us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891064.549133:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 92 00000100:00100000:0.0:1788891064.558603:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891064.560324:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919232 00000100:00100000:2.0:1788891064.560337:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919232 00000100:00100000:2.0:1788891064.560398:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 93 00000100:00100000:2.0:1788891064.560408:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+12:13881:x1875787987919232:12345-192.168.204.18@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788891064.560444:0:14330:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788891064.560467:0:14330:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788891064.560471:0:14330:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788891064.560474:0:14330:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788891064.560476:0:14330:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788891064.566036:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+12:13881:x1875787987919232:12345-192.168.204.18@tcp:256:mount.lustre.0 Request processed in 5619us (7431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891064.566051:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 93 00000100:00100000:1.0:1788891064.574454:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891064.574595:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919360 00000100:00100000:0.0:1788891064.574617:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919360 00000100:00100000:0.0:1788891064.574669:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 94 00000100:00100000:0.0:1788891064.574679:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+12:13881:x1875787987919360:12345-192.168.204.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788891064.574695:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891064.574711:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a20f2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891064.574739:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20f2 expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891064.574750:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20f2 expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891064.574758:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1ffc04c00, rc 0) 00000100:00100000:0.0:1788891064.575524:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+13:13881:x1875787987919360:12345-192.168.204.18@tcp:101:mount.lustre.0 Request processed in 844us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891064.575532:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 94 00000100:00100000:0.0:1788891064.579219:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891064.579302:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919488 00000100:00100000:1.0:1788891064.579311:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919488 00000100:00100000:1.0:1788891064.579387:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 95 00000100:00100000:1.0:1788891064.579394:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+13:13881:x1875787987919488:12345-192.168.204.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788891064.579682:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+13:13881:x1875787987919488:12345-192.168.204.18@tcp:501:mount.lustre.0 Request processed in 286us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891064.579689:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 95 00000100:00100000:2.0:1788891064.583377:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891064.583578:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919616 00000100:00100000:1.0:1788891064.583587:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919616 00000100:00100000:1.0:1788891064.583638:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 96 00000100:00100000:1.0:1788891064.583647:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+13:13881:x1875787987919616:12345-192.168.204.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788891064.583867:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+13:13881:x1875787987919616:12345-192.168.204.18@tcp:503:mount.lustre.0 Request processed in 221us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891064.583875:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 96 00000100:00100000:0.0:1788891064.587302:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891064.587383:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919744 00000100:00100000:1.0:1788891064.587402:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919744 00000100:00100000:1.0:1788891064.587459:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 97 00000100:00100000:1.0:1788891064.587468:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+13:13890:x1875787987919744:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788891064.588090:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+13:13890:x1875787987919744:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 621us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891064.588100:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 97 00000100:00100000:1.0:1788891064.592994:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891064.593292:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987919872 00000100:00100000:3.0:1788891064.593301:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987919872 00000100:00100000:3.0:1788891064.593356:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 98 00000100:00100000:3.0:1788891064.593366:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+13:13890:x1875787987919872:12345-192.168.204.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788891064.593602:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+13:13890:x1875787987919872:12345-192.168.204.18@tcp:502:llog_process_th.0 Request processed in 237us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.593611:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 98 00000100:00100000:0.0:1788891064.598206:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891064.598426:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920000 00000100:00100000:3.0:1788891064.598436:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920000 00000100:00100000:3.0:1788891064.598487:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:3.0:1788891064.598496:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2371:x1875787987920000:12345-192.168.204.18@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788891064.598524:0:14337:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 991926de-96d8-4a83-9572-e38119e78dc2@192.168.204.18@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:3.0:1788891064.598565:0:14337:0:(genops.c:1385:class_connect()) connect: client 991926de-96d8-4a83-9572-e38119e78dc2, cookie 0x9161b78f8ec40228 00000004:00100000:3.0:1788891064.598594:0:14337:0:(mdt_handler.c:7304:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788891064.598710:0:14337:0:(import.c:65:import_set_state_nolock()) ffff9da1f4ef2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788891064.598863:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:991926de-96d8-4a83-9572-e38119e78dc2+6:2371:x1875787987920000:12345-192.168.204.18@tcp:38:mount.lustre.0 Request processed in 366us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.598871:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:0.0:1788891064.607828:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891064.607924:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920256 00000100:00100000:1.0:1788891064.607934:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920256 00000100:00100000:1.0:1788891064.608047:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:1.0:1788891064.608058:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:991926de-96d8-4a83-9572-e38119e78dc2+6:13881:x1875787987920256:12345-192.168.204.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788891064.608088:0:14336:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788891064.608209:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:991926de-96d8-4a83-9572-e38119e78dc2+6:13881:x1875787987920256:12345-192.168.204.18@tcp:41:mount.lustre.0 Request processed in 152us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891064.608217:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00080000:0.0:1788891064.608624:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891064.609590:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891064.609658:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920128 00000100:00100000:3.0:1788891064.609664:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920128 00000100:00100000:3.0:1788891064.609708:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:3.0:1788891064.609717:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:991926de-96d8-4a83-9572-e38119e78dc2+6:0:x1875787987920128:12345-192.168.204.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788891064.609751:0:14337:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788891064.609822:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:991926de-96d8-4a83-9572-e38119e78dc2+6:0:x1875787987920128:12345-192.168.204.18@tcp:41:mount.lustre.0 Request processed in 106us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.609828:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:2.0:1788891064.615578:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891064.615675:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920384 00000100:00100000:1.0:1788891064.615685:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920384 00000100:00100000:1.0:1788891064.615751:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:1.0:1788891064.615761:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:991926de-96d8-4a83-9572-e38119e78dc2+6:13881:x1875787987920384:12345-192.168.204.18@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788891064.615871:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:991926de-96d8-4a83-9572-e38119e78dc2+6:13881:x1875787987920384:12345-192.168.204.18@tcp:40:mount.lustre.0 Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891064.615879:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:1.0:1788891064.619090:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891064.619132:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891064.619200:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891064.619300:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920512 00000100:00100000:0.0:1788891064.619309:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920512 00000100:00100000:3.0:1788891064.619312:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920768 00000100:00100000:3.0:1788891064.619319:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920768 00000100:00100000:0.0:1788891064.619350:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920640 00000100:00100000:0.0:1788891064.619355:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920640 00000100:00100000:3.0:1788891064.619359:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:3.0:1788891064.619371:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:991926de-96d8-4a83-9572-e38119e78dc2+6:13881:x1875787987920768:12345-192.168.204.18@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788891064.619388:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:0.0:1788891064.619396:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2371:x1875787987920512:12345-192.168.204.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788891064.619424:0:15021:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 991926de-96d8-4a83-9572-e38119e78dc2@192.168.204.18@tcp t0 exp 0000000000000000 cur 288 last 0 00000004:00200000:3.0:1788891064.619443:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000020:00000080:0.0:1788891064.619461:0:15021:0:(genops.c:1385:class_connect()) connect: client 991926de-96d8-4a83-9572-e38119e78dc2, cookie 0x9161b78f8ec4022f 00002000:00100000:0.0:1788891064.619474:0:15021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 991926de-96d8-4a83-9572-e38119e78dc2/ffff9da1f4b0a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788891064.619486:0:15021:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788891064.619515:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:991926de-96d8-4a83-9572-e38119e78dc2+6:13881:x1875787987920768:12345-192.168.204.18@tcp:33:mount.lustre.0 Request processed in 145us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.619524:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 1 00002000:00080000:0.0:1788891064.619635:0:15021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788891064.619661:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00080000:0.0:1788891064.619663:0:15021:0:(import.c:65:import_set_state_nolock()) ffff9da1f9bc3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891064.619670:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2371:x1875787987920640:12345-192.168.204.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788891064.619689:0:15018:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 991926de-96d8-4a83-9572-e38119e78dc2@192.168.204.18@tcp t0 exp 0000000000000000 cur 288 last 0 00000100:00100000:0.0:1788891064.619711:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:991926de-96d8-4a83-9572-e38119e78dc2+6:2371:x1875787987920512:12345-192.168.204.18@tcp:8:mount.lustre.0 Request processed in 314us (578us total) trans 0 rc 0/0 00000020:00000080:2.0:1788891064.619712:0:15018:0:(genops.c:1385:class_connect()) connect: client 991926de-96d8-4a83-9572-e38119e78dc2, cookie 0x9161b78f8ec40236 00002000:00100000:2.0:1788891064.619720:0:15018:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 991926de-96d8-4a83-9572-e38119e78dc2/ffff9da2016ac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788891064.619724:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 11 00002000:00100000:2.0:1788891064.619731:0:15018:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788891064.619815:0:15018:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788891064.619833:0:15018:0:(import.c:65:import_set_state_nolock()) ffff9da2016ab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788891064.619858:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:991926de-96d8-4a83-9572-e38119e78dc2+6:2371:x1875787987920640:12345-192.168.204.18@tcp:8:mount.lustre.0 Request processed in 188us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891064.619866:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:2.0:1788891064.740084:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891064.740207:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987920896 00000100:00100000:3.0:1788891064.740217:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987920896 00000100:00100000:3.0:1788891064.740274:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:3.0:1788891064.740284:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:991926de-96d8-4a83-9572-e38119e78dc2+6:13911:x1875787987920896:12345-192.168.204.18@tcp:101:mkdir.0 00010000:00010000:3.0:1788891064.740303:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891064.740325:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec4023d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a211c expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891064.740385:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891064.740406:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891064.740424:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891064.740473:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788891064.740477:0:14337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788891064.740503:0:14337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891064.740528:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec4023d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a211c expref: 8 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891064.740552:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a211c expref: 7 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891064.740561:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c9a55700) 00010000:00010000:3.0:1788891064.740563:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891064.740567:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030800, rc 0) 00000100:00100000:3.0:1788891064.740630:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:991926de-96d8-4a83-9572-e38119e78dc2+7:13911:x1875787987920896:12345-192.168.204.18@tcp:101:mkdir.0 Request processed in 348us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891064.740638:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 14 00010000:00010000:1.0:1788891064.886318:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891065.910304:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788891066.474876:0:16295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788891066.934493:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996290560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891066.934574:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891066.934670:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996290560 00000100:00100000:2.0:1788891066.934678:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996290560 00000100:00100000:2.0:1788891066.934748:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788891066.934758:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875787996290560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788891066.934795:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788891066.934952:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875787996290560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891066.934960:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788891066.934982:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891066.935021:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996290560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891066.935526:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996290688:0@lo:400:kworker.0 00000100:00100000:2.0:1788891066.935563:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891066.935590:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996291200:0@lo:400:kworker.0 00000100:00100000:2.0:1788891066.935618:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891066.935639:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788891066.935646:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996290816:0@lo:400:kworker.0 00000100:00100000:2.0:1788891066.935668:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891066.935697:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996290688 00000100:00100000:2.0:1788891066.935702:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996290688 00000100:00100000:2.0:1788891066.935731:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788891066.935751:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:3279:x1875787996290688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891066.935789:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:3279:x1875787996290688:12345-0@lo:400:kworker.0 Request processed in 39us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891066.935796:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788891066.935904:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996290816 00000100:00100000:0.0:1788891066.935909:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996290816 00000100:00100000:0.0:1788891066.935950:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788891066.935960:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996290816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891066.935977:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996291200 00000100:00100000:2.0:1788891066.935982:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996291200 00000100:00100000:0.0:1788891066.936002:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996290816:12345-0@lo:400:kworker.0 Request processed in 44us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891066.936010:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788891066.936026:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788891066.936036:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996291200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891066.936076:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875787996291200:12345-0@lo:400:kworker.0 Request processed in 42us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891066.936083:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788891066.941024:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891066.942676:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996291072:0@lo:400:kworker.0 00000100:00100000:1.0:1788891066.942770:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891066.942813:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788891066.942821:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996290944:0@lo:400:kworker.0 00000100:00100000:1.0:1788891066.942850:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891066.942893:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996291072 00000100:00100000:1.0:1788891066.942901:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996291072 00000100:00100000:1.0:1788891066.942992:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996290944 00000100:00100000:1.0:1788891066.942997:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996290944 00000100:00100000:1.0:1788891066.943018:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788891066.943029:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996291072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788891066.943091:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875787996291072:12345-0@lo:400:kworker.0 Request processed in 64us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891066.947020:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788891066.948138:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788891066.948157:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891066.948266:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875787996290944:12345-0@lo:400:kworker.0 Request processed in 117us (5414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891066.948274:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788891066.949518:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875787996290944:0@lo:400:kworker.0 00000100:00100000:1.0:1788891066.949537:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1875787996291072:0@lo:400:kworker.0 00000100:00080000:1.0:1788891066.950563:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788891066.950570:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891066.952607:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996290816:0@lo:400:kworker.0 00000100:00100000:2.0:1788891066.952629:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996290688:0@lo:400:kworker.0 00000100:00100000:2.0:1788891066.952645:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1875787996291200:0@lo:400:kworker.0 00000001:00080000:1.0:1788891066.991681:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788891066.991754:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdb24183-3512-436a-9819-5b2ea51da239 00000001:00100000:1.0:1788891066.991761:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 991926de-96d8-4a83-9572-e38119e78dc2 00000001:00100000:2.0:1788891067.488585:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdb24183-3512-436a-9819-5b2ea51da239 00000001:00100000:2.0:1788891067.488603:0:5836:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 991926de-96d8-4a83-9572-e38119e78dc2 00010000:00010000:1.0:1788891067.960549:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788891067.992020:0:6689:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 991926de-96d8-4a83-9572-e38119e78dc2 00000100:00100000:1.0:1788891068.470697:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788891068.470737:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996291328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788891068.470803:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891068.470936:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996291328 00000100:00100000:3.0:1788891068.470945:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996291328 00000100:00100000:3.0:1788891068.471009:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891068.471020:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996291328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788891068.471053:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788891068.471102:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875787996291328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891068.471109:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891068.471156:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1875787996291328:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788891068.471383:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788891068.690396:0:16444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff578ec370 20000000:00000080:3.0:1788891068.690412:0:16444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9da0c37fbc00 uarg=0000000000000000 20000000:01000000:3.0:1788891068.690447:0:16444:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788891068.690454:0:16444:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788891068.690459:0:16444:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788891068.691757:0:16445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788891068.692054:0:16444:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788891068.698567:0:16444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788891068.698597:0:16444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698616:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff3b expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698624:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec3ff88 expref: 18 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698631:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec400bc expref: 18 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698650:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2090 expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698657:0:16444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20f2 expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698665:0:16444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698721:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20f2 expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698754:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20f2 expref: 12 pid: 14329 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891068.698769:0:16444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291456:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788891068.698888:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2090 expref: 12 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698897:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2090 expref: 12 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891068.698905:0:16444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f22680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291584:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788891068.698934:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec400bc expref: 18 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.698942:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec400bc expref: 18 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891068.698951:0:16444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291712:0@lo:104: 00000100:00100000:3.0:1788891068.698987:0:16444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788891068.699025:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ff88 expref: 18 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.699033:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff88 expref: 18 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891068.699041:0:16444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291840:0@lo:104: 00000100:00100000:3.0:1788891068.699058:0:16444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788891068.699106:0:16444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9161b78f8ec3ff3b expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891068.699114:0:16444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff3b expref: 18 pid: 14330 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891068.699122:0:16444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291968:0@lo:104: 00000100:00100000:3.0:1788891068.699145:0:16444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891068.699154:0:16444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1d158a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788891068.699543:0:14320:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788891068.699556:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996291712 00000100:00100000:2.0:1788891068.699562:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996291712 00000100:00100000:2.0:1788891068.699599:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996291840 00000100:00100000:2.0:1788891068.699601:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996291840 00000100:00100000:2.0:1788891068.699614:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996291968 00000100:00100000:2.0:1788891068.699615:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996291968 00000100:00100000:0.0:1788891068.699765:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891068.699778:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+5:16444:x1875787996291712:12345-0@lo:104: 00010000:00010000:0.0:1788891068.699791:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.699860:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788891068.699867:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+5:16444:x1875787996291712:12345-0@lo:104: Request processed in 94us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891068.699874:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788891068.699891:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788891068.699897:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+4:16444:x1875787996291840:12345-0@lo:104: 00010000:00010000:0.0:1788891068.699911:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.699950:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788891068.699956:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+4:16444:x1875787996291840:12345-0@lo:104: Request processed in 60us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891068.699963:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788891068.699977:0:16444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291712:0@lo:104: 00000100:00100000:0.0:1788891068.699981:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788891068.699992:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da2016df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:16444:x1875787996291968:12345-0@lo:104: 00000100:00100000:3.0:1788891068.699994:0:16444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291840:0@lo:104: 00010000:00010000:0.0:1788891068.700003:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.700048:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788891068.700053:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da2016df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+3:16444:x1875787996291968:12345-0@lo:104: Request processed in 63us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891068.700059:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788891068.700220:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788891068.700227:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700234:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb9c00 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:1.0:1788891068.700238:0:14325:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700247:0:14325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891068.700254:0:14325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891068.700260:0:14325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788891068.700292:0:14325:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700298:0:14325:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891068.700318:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700324:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da201cb9c00/0x9161b78f8ec400bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec400c3 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700336:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788891068.700339:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700351:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd200 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:1.0:1788891068.700354:0:14325:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700360:0:14325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891068.700366:0:14325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891068.700371:0:14325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788891068.700385:0:14325:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700392:0:14325:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891068.700398:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700404:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da1f4edd200/0x9161b78f8ec3ff88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ff8f expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700413:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891068.700416:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700422:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da201cb8800 already unused, calling callback (ffffffffc1dd7c20) 10000000:00010000:1.0:1788891068.700425:0:14325:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700442:0:14325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788891068.700448:0:14325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788891068.700453:0:14325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788891068.700465:0:14325:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700470:0:14325:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788891068.700485:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700491:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.118@tcp lock: ffff9da201cb8800/0x9161b78f8ec3ff3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9161b78f8ec3ff42 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700503:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891068.700505:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891068.700506:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891068.700529:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996292096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891068.700561:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891068.700592:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788891068.700598:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996292224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891068.700618:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891068.700643:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996292352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891068.700667:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891068.700713:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996292096 00000100:00100000:1.0:1788891068.700723:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996292096 00010000:00010000:1.0:1788891068.700742:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec400bc expref: 19 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891068.700757:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996292224 00000100:00100000:1.0:1788891068.700760:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996292224 00010000:00010000:1.0:1788891068.700772:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff88 expref: 20 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891068.700783:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996292352 00000100:00100000:1.0:1788891068.700785:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996292352 00010000:00010000:1.0:1788891068.700795:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff3b expref: 21 pid: 14330 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891068.700807:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788891068.700812:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+21:3281:x1875787996292096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891068.700822:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891068.700828:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec400bc expref: 21 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700838:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec400bc expref: 21 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891068.700849:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891068.700854:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6fa00/0x9161b78f8ec400c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec400bc expref: 21 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891068.700868:0:14323:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788891068.700870:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891068.700878:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788891068.700905:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+20:3281:x1875787996292096:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891068.700912:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788891068.700927:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891068.700941:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:3281:x1875787996292224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788891068.700950:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891068.700955:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff88 expref: 19 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700964:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff88 expref: 19 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700975:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1d0f6e200/0x9161b78f8ec3ff8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ff88 expref: 19 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.700985:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891068.701012:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:3281:x1875787996292224:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891068.701020:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788891068.701029:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5687850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:3279:x1875787996292352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788891068.701044:0:14323:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891068.701050:0:14323:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff3b expref: 18 pid: 14330 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891068.701060:0:14323:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9161b78f8ec3ff3b expref: 18 pid: 14330 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891068.701071:0:14323:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788891068.701103:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5687850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:3279:x1875787996292352:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (435us total) trans 0 rc 0/0 00010000:00010000:3.0:1788891068.701608:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c9c87e00/0x9161b78f8ec3ff42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9161b78f8ec3ff3b expref: 18 pid: 14330 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891068.701619:0:16444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291968:0@lo:104: 00000100:00100000:1.0:1788891068.701771:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788891068.701806:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3279:1875787996292352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891068.701832:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996292224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891068.701839:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3281:1875787996292096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788891068.702738:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891068.702749:0:16444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cafa6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291456:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788891068.702761:0:16444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f22680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16444:1875787996291584:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788891068.702806:0:16444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891068.702829:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891068.703729:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788891068.706960:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921024 00000100:00100000:0.0:1788891068.706986:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921024 00010000:00010000:0.0:1788891068.707040:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20f2 expref: 13 pid: 14329 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891068.707097:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921152 00000100:00100000:0.0:1788891068.707101:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921152 00010000:00010000:0.0:1788891068.707115:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2090 expref: 14 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891068.707133:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:0.0:1788891068.707141:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc193f55-7156-499f-9b02-e138dba3feae+14:2375:x1875787987921024:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891068.707188:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891068.707196:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20f2 expref: 14 pid: 14329 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707209:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20f2 expref: 14 pid: 14329 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707227:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40221 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20f2 expref: 14 pid: 14329 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707245:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891068.707298:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc193f55-7156-499f-9b02-e138dba3feae+13:2375:x1875787987921024:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 158us (4564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891068.707305:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:0.0:1788891068.707324:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:0.0:1788891068.707330:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc193f55-7156-499f-9b02-e138dba3feae+12:2375:x1875787987921152:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891068.707336:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891068.707341:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2090 expref: 12 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707352:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2090 expref: 12 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707363:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0031000/0x9161b78f8ec401e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2090 expref: 12 pid: 14331 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707671:0:14322:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707692:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707719:0:14322:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707727:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707734:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707741:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707748:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0030200 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:0.0:1788891068.707752:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707761:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707786:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891068.707797:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788891068.707825:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc193f55-7156-499f-9b02-e138dba3feae+11:2375:x1875787987921152:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 495us (4997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891068.707833:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 8 00010000:00010000:1.0:1788891068.707884:0:16444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.707893:0:16444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.707899:0:16444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9da1c0030200/0x9161b78f8ec4024b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891068.982341:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788891069.675696:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891069.675739:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891069.675762:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891069.675791:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891069.675815:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891069.675837:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891069.675869:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891069.675894:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921664 00000100:00100000:2.0:1788891069.675903:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921664 00000100:00100000:2.0:1788891069.675956:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921920 00000100:00100000:2.0:1788891069.675959:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921920 00000100:00100000:2.0:1788891069.675974:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921536 00000100:00100000:2.0:1788891069.675977:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921536 00000100:00100000:2.0:1788891069.675991:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922048 00000100:00100000:2.0:1788891069.675993:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922048 00000100:00100000:2.0:1788891069.676009:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:2.0:1788891069.676019:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+5:2375:x1875787987921664:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891069.676090:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+5:2375:x1875787987921664:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 72us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891069.676112:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:2.0:1788891069.676132:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:2.0:1788891069.676139:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:2375:x1875787987921920:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891069.676165:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:2375:x1875787987921920:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891069.676196:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:2.0:1788891069.676209:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:2.0:1788891069.676216:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+5:2375:x1875787987921536:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891069.676239:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+5:2375:x1875787987921536:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 24us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891069.676244:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:2.0:1788891069.676256:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:2.0:1788891069.676262:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:2375:x1875787987922048:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891069.676284:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:2375:x1875787987922048:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 22us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891069.676291:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:2.0:1788891069.676315:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921280 00000100:00100000:2.0:1788891069.676318:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921280 00000100:00100000:2.0:1788891069.676344:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 100 00000100:00100000:2.0:1788891069.676351:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+11:2375:x1875787987921280:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891069.676374:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+11:2375:x1875787987921280:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 24us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891069.676381:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 100 00000100:00100000:2.0:1788891069.676421:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921408 00000100:00100000:2.0:1788891069.676425:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921408 00000100:00100000:2.0:1788891069.676451:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987921792 00000100:00100000:2.0:1788891069.676454:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987921792 00000100:00100000:2.0:1788891069.676472:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:2.0:1788891069.676478:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+6:2375:x1875787987921408:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891069.676506:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+6:2375:x1875787987921408:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 27us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891069.676512:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:2.0:1788891069.676525:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:2.0:1788891069.676531:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:991926de-96d8-4a83-9572-e38119e78dc2+6:2375:x1875787987921792:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:2.0:1788891069.676556:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:991926de-96d8-4a83-9572-e38119e78dc2+6:2375:x1875787987921792:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 25us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891069.676563:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00080000:2.0:1788891069.676583:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788891069.676588:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788891069.676590:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788891069.804782:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891069.804862:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922176 00000100:00100000:0.0:1788891069.804884:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922176 00000100:00100000:0.0:1788891069.805949:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 101 00000100:00100000:0.0:1788891069.805963:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+11:13763:x1875787987922176:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891069.805981:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891069.805998:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40252 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2123 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891069.806024:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2123 expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891069.806035:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1ffc04c00/0x9161b78f8ec40252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2123 expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891069.806045:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1ffc04c00, rc 0) 00000100:00100000:0.0:1788891069.806112:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+12:13763:x1875787987922176:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 Request processed in 152us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891069.806118:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 101 00000100:00100000:2.0:1788891069.815421:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891069.817373:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922304 00000100:00100000:0.0:1788891069.817385:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922304 00000100:00100000:0.0:1788891069.817445:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 102 00000100:00100000:0.0:1788891069.817455:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f5f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+12:13763:x1875787987922304:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788891069.817741:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f5f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+12:13763:x1875787987922304:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 Request processed in 287us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891069.817749:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 102 00000100:00100000:2.0:1788891069.828977:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891069.829647:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922432 00000100:00100000:0.0:1788891069.829657:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922432 00000100:00100000:0.0:1788891069.829721:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 103 00000100:00100000:0.0:1788891069.829732:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+12:13763:x1875787987922432:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788891069.829998:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+12:13763:x1875787987922432:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 Request processed in 268us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891069.830007:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 103 00000100:00100000:2.0:1788891069.834300:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891069.834496:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922560 00000100:00100000:3.0:1788891069.834505:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922560 00000100:00100000:3.0:1788891069.834555:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 104 00000100:00100000:3.0:1788891069.834564:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ceb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+12:13763:x1875787987922560:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891069.834579:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891069.834595:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec40259 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a212a expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891069.834649:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec40259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a212a expref: 13 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891069.834660:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0030a00/0x9161b78f8ec40259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a212a expref: 13 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891069.834670:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030a00, rc 0) 00000100:00100000:3.0:1788891069.834736:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ceb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc193f55-7156-499f-9b02-e138dba3feae+13:13763:x1875787987922560:12345-192.168.204.18@tcp:101:ll_cfg_requeue.0 Request processed in 173us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891069.834743:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 104 00000100:00100000:2.0:1788891069.844917:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891069.845042:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922688 00000100:00100000:3.0:1788891069.845052:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922688 00000100:00100000:3.0:1788891069.845104:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 105 00000100:00100000:3.0:1788891069.845114:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+13:13763:x1875787987922688:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891069.845414:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc193f55-7156-499f-9b02-e138dba3feae+13:13763:x1875787987922688:12345-192.168.204.18@tcp:501:ll_cfg_requeue.0 Request processed in 301us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891069.845422:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 105 00000100:00100000:2.0:1788891069.847833:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891069.847905:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922816 00000100:00100000:3.0:1788891069.847914:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922816 00000100:00100000:3.0:1788891069.847963:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 106 00000100:00100000:3.0:1788891069.847972:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+13:13763:x1875787987922816:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788891069.848187:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+13:13763:x1875787987922816:12345-192.168.204.18@tcp:503:ll_cfg_requeue.0 Request processed in 215us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891069.848196:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 106 00010000:00010000:0.0:1788891070.007948:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788891070.071239:0:14333:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788891070.071246:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1ffeb9000 from 10 10000000:01000000:1.0:1788891070.071251:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788891070.071295:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec40260 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891070.071305:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec40260 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891070.071317:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec40260 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891070.071342:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788891070.071412:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891070.071459:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c937a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788891070.071529:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996292480 00000100:00100000:2.0:1788891070.071537:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996292480 00000100:00100000:2.0:1788891070.071581:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788891070.071600:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+16:14333:x1875787996292480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891070.071620:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891070.071749:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c9c86600/0x9161b78f8ec40267 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec40260 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.071773:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c9c86600/0x9161b78f8ec40267 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec40260 expref: 17 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.071783:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c9c86600/0x9161b78f8ec40267 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec40260 expref: 17 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.071791:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86600, rc 0) 00000100:00100000:2.0:1788891070.071836:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:14333:x1875787996292480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891070.071842:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788891070.071913:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788891070.071926:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec40260 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec40267 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891070.071935:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec40260 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec40267 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891070.071982:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891070.072006:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891070.072026:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c937a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788891070.072105:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996292608 00000100:00100000:3.0:1788891070.072115:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996292608 00000100:00100000:3.0:1788891070.072138:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788891070.072143:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:14333:x1875787996292608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891070.072382:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:14333:x1875787996292608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891070.072389:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788891070.072454:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891070.072486:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1cae20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788891070.072518:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891070.072537:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c937a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788891070.072755:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996292736 00000100:00100000:2.0:1788891070.072761:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996292736 00000100:00100000:2.0:1788891070.072780:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788891070.072787:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:14333:x1875787996292736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891070.072929:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:14333:x1875787996292736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891070.072936:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788891070.073026:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1cae20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788891070.074161:0:16538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788891070.074893:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788891070.074913:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788891070.074923:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec40260 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec40267 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.074934:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1d0f6ee00/0x9161b78f8ec40260 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec40267 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891070.074956:0:14333:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788891070.074960:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da1d0e5a800 from 10 10000000:01000000:2.0:1788891070.074962:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788891070.074997:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec4026e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.075004:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec4026e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.075015:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec4026e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891070.075037:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788891070.075092:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891070.075146:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891070.075379:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996292864 00000100:00100000:3.0:1788891070.075387:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996292864 00000100:00100000:3.0:1788891070.075422:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788891070.075431:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+17:14333:x1875787996292864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891070.075444:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891070.075456:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec40275 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec4026e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891070.075479:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec40275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec4026e expref: 18 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891070.075488:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0031600/0x9161b78f8ec40275 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec4026e expref: 18 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891070.075497:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0031600, rc 0) 00000100:00100000:3.0:1788891070.075532:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:14333:x1875787996292864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891070.075538:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788891070.075622:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788891070.075646:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec4026e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec40275 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.075656:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec4026e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec40275 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891070.075716:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788891070.075741:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891070.075766:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700840 going to sleep for 11 seconds 00000100:00100000:3.0:1788891070.076085:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996292992 00000100:00100000:3.0:1788891070.076090:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996292992 00000100:00100000:3.0:1788891070.076123:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788891070.076131:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:14333:x1875787996292992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788891070.076395:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:14333:x1875787996292992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891070.076402:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788891070.076685:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996292992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788891070.076721:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996293120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788891070.076763:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891070.076792:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788891070.076971:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996293120 00000100:00100000:3.0:1788891070.076976:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996293120 00000100:00100000:3.0:1788891070.077013:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788891070.077021:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:14333:x1875787996293120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788891070.077192:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:14333:x1875787996293120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891070.077200:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788891070.077239:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996293120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788891070.078228:0:16540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788891070.078426:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788891070.078446:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788891070.078465:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec4026e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec40275 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.078475:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c87a00/0x9161b78f8ec4026e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec40275 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788891070.078485:0:14333:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788891070.078488:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9da0c1acc000 from 10 10000000:01000000:2.0:1788891070.078491:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788891070.078519:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86c00/0x9161b78f8ec4027c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.078526:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86c00/0x9161b78f8ec4027c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891070.078535:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86c00/0x9161b78f8ec4027c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891070.078555:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996293248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788891070.078611:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891070.078787:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700180 going to sleep for 11 seconds 00000100:00100000:3.0:1788891070.078846:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996293248 00000100:00100000:3.0:1788891070.078852:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996293248 00000100:00100000:3.0:1788891070.078892:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788891070.078900:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ceac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+18:14333:x1875787996293248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788891070.078911:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891070.078924:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec40283 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9161b78f8ec4027c expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891070.078946:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec40283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9161b78f8ec4027c expref: 19 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891070.078955:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9da1c0030000/0x9161b78f8ec40283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9161b78f8ec4027c expref: 19 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891070.078963:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030000, rc 0) 00000100:00100000:3.0:1788891070.079091:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ceac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:14333:x1875787996293248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891070.079097:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788891070.081566:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996293248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788891070.081594:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86c00/0x9161b78f8ec4027c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec40283 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891070.081607:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86c00/0x9161b78f8ec4027c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9161b78f8ec40283 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891070.081695:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996293376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788891070.081876:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891070.081925:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe000 going to sleep for 11 seconds 00000100:00100000:1.0:1788891070.082211:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996293376 00000100:00100000:1.0:1788891070.082218:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996293376 00000100:00100000:1.0:1788891070.082264:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788891070.082273:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:14333:x1875787996293376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788891070.082514:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:14333:x1875787996293376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891070.082521:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788891070.083331:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996293376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788891070.083371:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996293504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788891070.083417:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891070.083459:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe000 going to sleep for 11 seconds 00000100:00100000:2.0:1788891070.083739:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996293504 00000100:00100000:2.0:1788891070.083745:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996293504 00000100:00100000:2.0:1788891070.083789:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788891070.083798:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:14333:x1875787996293504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788891070.083982:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:14333:x1875787996293504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891070.083990:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788891070.084068:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73a29ebe-4d40-4a82-b77a-4b1222504c0e:14333:1875787996293504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788891070.085366:0:16542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788891070.085547:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788891070.085567:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788891070.085578:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86c00/0x9161b78f8ec4027c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec40283 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891070.085588:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.118@tcp lock: ffff9da1c9c86c00/0x9161b78f8ec4027c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9161b78f8ec40283 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891070.199804:0:14371:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788891070.199818:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891070.200338:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788891070.200410:0:14371:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891070.200445:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1788891071.030491:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788891071.114029:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.114127:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987922944 00000100:00100000:2.0:1788891071.114150:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987922944 00000100:00100000:2.0:1788891071.114291:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00100000:2.0:1788891071.114306:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+6:14421:x1875787987922944:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891071.114329:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891071.114358:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec4028a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2131 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114431:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114446:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114457:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114470:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114476:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114482:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114792:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec4029f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114801:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec4029f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114808:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec4029f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891071.114850:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788891071.114856:0:14337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788891071.114902:0:14337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec4029f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114913:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114919:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114926:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114931:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891071.114934:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114940:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114952:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c9a55700) 00010000:00010000:2.0:1788891071.114955:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891071.114960:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114965:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114977:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114992:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.114998:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.115003:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891071.115006:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.115012:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.115020:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9da1c2aee800) 00010000:00010000:2.0:1788891071.115022:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891071.115025:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.115030:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec40298 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.115061:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec4028a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2131 expref: 8 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.115074:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86e00/0x9161b78f8ec4029f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2131 expref: 7 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.115082:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788891071.115084:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891071.115094:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86e00, rc 0) 00000100:00100000:2.0:1788891071.115230:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+7:14421:x1875787987922944:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 927us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891071.115240:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00080000:1.0:1788891071.116050:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788891071.126555:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.126667:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923200 00000100:00100000:2.0:1788891071.126678:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923200 00000100:00100000:2.0:1788891071.126739:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:2.0:1788891071.126750:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+7:14421:x1875787987923200:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891071.126771:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891071.126792:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2138 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.126868:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.126882:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.126893:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.126963:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.126970:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.126977:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.129761:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec402bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.129792:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec402bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.129803:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec402bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891071.129818:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788891071.129998:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130006:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130028:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130035:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891071.130039:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130046:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130058:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9da1c2aeea00) 00010000:00010000:2.0:1788891071.130061:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891071.130065:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130070:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130082:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130093:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130099:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130104:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891071.130107:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130112:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130119:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9da1c2aee800) 00010000:00010000:2.0:1788891071.130121:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891071.130124:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.130130:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.131253:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2138 expref: 10 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.131809:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86800/0x9161b78f8ec402bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2138 expref: 9 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.131819:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:2.0:1788891071.131822:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891071.131832:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86800, rc 0) 00000100:00100000:2.0:1788891071.131958:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+9:14421:x1875787987923200:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 5209us (5411us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788891071.131969:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:0.0:1788891071.135525:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.135956:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923328 00000100:00100000:2.0:1788891071.135966:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923328 00000100:00100000:2.0:1788891071.136034:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:2.0:1788891071.136045:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+9:14421:x1875787987923328:12345-192.168.204.18@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788891071.136151:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+9:14421:x1875787987923328:12345-192.168.204.18@tcp:59:lhsmtool_posix.0 Request processed in 107us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891071.136158:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:1.0:1788891071.187361:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.187484:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923456 00000100:00100000:3.0:1788891071.187493:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923456 00000100:00100000:3.0:1788891071.187556:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:3.0:1788891071.187567:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+9:14427:x1875787987923456:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788891071.187587:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891071.187609:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec402c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a213f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187686:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187702:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187716:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187731:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187739:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187745:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187951:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187964:0:14338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187970:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187975:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.187979:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.187987:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188000:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c9a55700) 00010000:00010000:3.0:1788891071.188003:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.188008:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188014:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec402d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188026:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188032:0:14338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188038:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188042:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.188051:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188058:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188066:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9da1d35fe900) 00010000:00010000:3.0:1788891071.188069:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.188072:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188077:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec402d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188109:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec402c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a213f expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188120:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c9a55700) 00010000:00010000:3.0:1788891071.188122:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.188126:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec402c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a213f expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.188136:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030200, rc 0) 00000100:00100000:3.0:1788891071.188553:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+9:14427:x1875787987923456:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 986us (1199us total) trans 0 rc 301/301 00000100:00100000:3.0:1788891071.188563:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:1.0:1788891071.199368:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891071.199505:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923584 00000100:00100000:0.0:1788891071.199514:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923584 00000100:00100000:0.0:1788891071.199622:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:0.0:1788891071.199633:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fdb24183-3512-436a-9819-5b2ea51da239+9:14427:x1875787987923584:12345-192.168.204.18@tcp:700:lfs.0 00000100:00100000:0.0:1788891071.199732:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fdb24183-3512-436a-9819-5b2ea51da239+9:14427:x1875787987923584:12345-192.168.204.18@tcp:700:lfs.0 Request processed in 100us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891071.199740:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:1.0:1788891071.202342:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.202458:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923840 00000100:00100000:2.0:1788891071.202468:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923840 00000100:00100000:2.0:1788891071.202567:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:2.0:1788891071.202577:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+9:14427:x1875787987923840:12345-192.168.204.18@tcp:36:lfs.0 00010000:00010000:2.0:1788891071.202630:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891071.202670:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4020c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a20ba expref: 9 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.202689:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c9a55700) 00010000:00010000:2.0:1788891071.202695:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891071.202926:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.202939:0:14337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a211c expref: 5 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.202957:0:14337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.202990:0:14337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a211c expref: 5 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.203003:0:14337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a211c expref: 5 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891071.203018:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14337:1875787996293632:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788891071.203542:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700840 going to sleep for 11 seconds 00000100:00100000:2.0:1788891071.206760:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14337:1875787996293632:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788891071.206789:0:14337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891071.208215:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.211921:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987923968 00000100:00100000:3.0:1788891071.211938:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987923968 00010000:00010000:3.0:1788891071.212009:0:16446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a211c expref: 6 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788891071.212045:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891071.212073:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:3.0:1788891071.212084:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:991926de-96d8-4a83-9572-e38119e78dc2+6:2374:x1875787987923968:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891071.212099:0:16446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891071.212106:0:16446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a211c expref: 6 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.212119:0:16446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a211c expref: 6 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.212141:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec40244 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a211c expref: 6 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.212158:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c9a55700) 00010000:00010000:3.0:1788891071.212163:0:16446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.212189:0:16446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.212197:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.212391:0:14337:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.212402:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.212427:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.212437:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.212445:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.212566:0:16446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891071.212645:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:2374:x1875787987923968:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 561us (4860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.212666:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000004:00200000:2.0:1788891071.217345:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788891071.217365:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.217376:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.217384:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.217391:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891071.217396:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.217405:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.217421:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c9a55700) 00010000:00010000:2.0:1788891071.217424:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891071.217428:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.217435:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891071.217455:0:14337:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000827f6a9e reply state 00000000aa90d3df transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891071.217464:0:14337:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788891071.217617:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+10:14427:x1875787987923840:12345-192.168.204.18@tcp:36:lfs.0 Request processed in 15038us (15281us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788891071.217643:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 19 00010000:00010000:3.0:1788891071.221816:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.221853:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.221864:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.221872:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c86200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.221877:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.221886:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.221906:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9da1c2aee800) 00010000:00010000:3.0:1788891071.221911:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.221915:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.221923:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec402e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788891071.222799:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788891071.302938:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.303126:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924096 00000100:00100000:3.0:1788891071.303137:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924096 00000100:00100000:2.0:1788891071.305305:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 20 00000100:00100000:2.0:1788891071.305328:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+9:14435:x1875787987924096:12345-192.168.204.18@tcp:101:lctl.0 00010000:00010000:2.0:1788891071.305353:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891071.305379:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2146 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.305445:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.305459:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.305471:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891071.305508:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788891071.305512:0:14336:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788891071.305549:0:14336:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.305573:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec402ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2146 expref: 11 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.305593:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87e00/0x9161b78f8ec402f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2146 expref: 10 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.305602:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788891071.305616:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788891071.305620:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c87e00, rc 0) 00000100:00100000:2.0:1788891071.305703:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+10:14435:x1875787987924096:12345-192.168.204.18@tcp:101:lctl.0 Request processed in 385us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891071.305712:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 20 00000100:00100000:1.0:1788891071.335057:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.335225:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924224 00000100:00100000:3.0:1788891071.335236:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924224 00000100:00100000:3.0:1788891071.335298:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:3.0:1788891071.335309:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:14436:x1875787987924224:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788891071.335328:0:15747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891071.335349:0:15747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec402fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a214d expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.335425:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec40301 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.335439:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec40301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.335451:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec40301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891071.335485:0:15747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788891071.335489:0:15747:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788891071.335509:0:15747:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec40301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.335534:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030800/0x9161b78f8ec402fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a214d expref: 7 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.335553:0:15747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0030200/0x9161b78f8ec40301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a214d expref: 6 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.335562:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788891071.335565:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891071.335568:0:15747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c0030200, rc 0) 00000100:00100000:3.0:1788891071.335628:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:991926de-96d8-4a83-9572-e38119e78dc2+6:14436:x1875787987924224:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 320us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.335636:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 21 00000100:00100000:1.0:1788891071.339016:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.339156:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924352 00000100:00100000:3.0:1788891071.339166:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924352 00000100:00100000:3.0:1788891071.339275:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 22 00000100:00100000:3.0:1788891071.339285:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:991926de-96d8-4a83-9572-e38119e78dc2+6:14436:x1875787987924352:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788891071.339304:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891071.339325:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec40308 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2154 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339391:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339405:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339416:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339431:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339437:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339444:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339585:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd200/0x9161b78f8ec4031d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339594:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd200/0x9161b78f8ec4031d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339601:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd200/0x9161b78f8ec4031d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891071.339641:0:14338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788891071.339644:0:14338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788891071.339675:0:14338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd200/0x9161b78f8ec4031d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339686:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339693:0:14338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339700:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339705:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.339709:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339717:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339728:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788891071.339731:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.339736:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339743:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031000/0x9161b78f8ec4030f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339756:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339772:0:14338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339778:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339783:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c0031200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.339787:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339793:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339801:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9da1d35fe900) 00010000:00010000:3.0:1788891071.339803:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.339883:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339890:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031200/0x9161b78f8ec40316 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339923:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c0031400/0x9161b78f8ec40308 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2154 expref: 8 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339936:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd200/0x9161b78f8ec4031d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2154 expref: 7 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.339943:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9da1d35fe700) 00010000:00010000:3.0:1788891071.339946:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891071.339954:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd200, rc 0) 00000100:00100000:3.0:1788891071.340295:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:991926de-96d8-4a83-9572-e38119e78dc2+7:14436:x1875787987924352:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 1010us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.340303:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 22 00000100:00100000:1.0:1788891071.343992:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.344131:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924608 00000100:00100000:3.0:1788891071.345597:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924608 00000100:00100000:3.0:1788891071.345680:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:3.0:1788891071.345709:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:991926de-96d8-4a83-9572-e38119e78dc2+7:14436:x1875787987924608:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788891071.345728:0:15747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891071.345749:0:15747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec40324 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a215b expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891071.345850:0:15747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788891071.345971:0:15747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec40324 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a215b expref: 9 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.345985:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788891071.345988:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891071.345993:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec40324 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a215b expref: 9 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.346006:0:15747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd400, rc 0) 00000100:00100000:3.0:1788891071.346076:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:991926de-96d8-4a83-9572-e38119e78dc2+8:14436:x1875787987924608:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 370us (2094us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788891071.346082:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 23 00000100:00100000:1.0:1788891071.353278:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.353386:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987924864 00000100:00100000:2.0:1788891071.353401:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987924864 00000100:00100000:2.0:1788891071.353513:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 24 00000100:00100000:2.0:1788891071.353525:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:991926de-96d8-4a83-9572-e38119e78dc2+8:14436:x1875787987924864:12345-192.168.204.18@tcp:36:lfs.0 00010000:00010000:2.0:1788891071.353592:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891071.353618:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd200/0x9161b78f8ec4031d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2154 expref: 8 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.353635:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9da1d35fe700) 00010000:00010000:2.0:1788891071.353661:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788891071.353686:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.353700:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.353709:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788891071.353921:0:14336:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc3cedd3 reply state 00000000841f59dc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891071.353931:0:14336:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788891071.353939:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788891071.354023:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:991926de-96d8-4a83-9572-e38119e78dc2+9:14436:x1875787987924864:12345-192.168.204.18@tcp:36:lfs.0 Request processed in 500us (754us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788891071.354043:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 24 00010000:00010000:3.0:1788891071.355549:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.355576:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.355583:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.355589:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1c9c87400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.355594:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.355601:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.355616:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9da1c2aeee00) 00010000:00010000:3.0:1788891071.355619:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788891071.355624:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.355630:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c87400/0x9161b78f8ec40332 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891071.356118:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.356218:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925120 00000100:00100000:3.0:1788891071.356228:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925120 00000100:00100000:3.0:1788891071.356271:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:3.0:1788891071.356281:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:991926de-96d8-4a83-9572-e38119e78dc2+8:14436:x1875787987925120:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788891071.356864:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:991926de-96d8-4a83-9572-e38119e78dc2+9:14436:x1875787987925120:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 583us (748us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788891071.356878:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:1.0:1788891071.359985:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.360082:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925376 00000100:00100000:2.0:1788891071.360091:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925376 00000100:00100000:2.0:1788891071.360154:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 25 00000100:00100000:2.0:1788891071.360164:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cae23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:991926de-96d8-4a83-9572-e38119e78dc2+9:14436:x1875787987925376:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:2.0:1788891071.360222:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891071.360245:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40339 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2162 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360332:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360347:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360358:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360372:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360379:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360385:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891071.360498:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788891071.360581:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360588:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360594:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360600:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f9bba600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891071.360604:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360611:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360623:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788891071.360626:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891071.360631:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360637:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360668:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360673:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360689:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360694:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f9bba800 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891071.360697:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360702:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360710:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9da1c2aeec00) 00010000:00010000:2.0:1788891071.360713:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891071.360716:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360722:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec40347 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360755:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40339 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2162 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360765:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:2.0:1788891071.360767:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891071.360770:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1c9c86200/0x9161b78f8ec40339 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2162 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.360779:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1c9c86200, rc 0) 00000100:00100000:2.0:1788891071.361414:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cae23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:991926de-96d8-4a83-9572-e38119e78dc2+10:14436:x1875787987925376:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 1248us (1436us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788891071.361431:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 25 00000100:00100000:1.0:1788891071.363726:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.363924:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925504 00000100:00100000:3.0:1788891071.363934:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925504 00000100:00100000:3.0:1788891071.364038:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 26 00000100:00100000:3.0:1788891071.364050:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:991926de-96d8-4a83-9572-e38119e78dc2+10:14436:x1875787987925504:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788891071.364085:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891071.364108:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec40355 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2169 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.364238:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.364250:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.364261:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891071.364286:0:14338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788891071.364289:0:14338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788891071.364305:0:14338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.364328:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec40355 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2169 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.364344:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2169 expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.364351:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9da1d35fe900) 00010000:00010000:3.0:1788891071.364354:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788891071.364357:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edca00, rc 0) 00000100:00100000:3.0:1788891071.364418:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:991926de-96d8-4a83-9572-e38119e78dc2+11:14436:x1875787987925504:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 371us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.364434:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 26 00000100:00100000:1.0:1788891071.367513:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.367592:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925632 00000100:00100000:3.0:1788891071.367602:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925632 00000100:00100000:3.0:1788891071.367669:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:3.0:1788891071.367680:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:991926de-96d8-4a83-9572-e38119e78dc2+11:14436:x1875787987925632:12345-192.168.204.18@tcp:37:lfs.0 00000100:00100000:2.0:1788891071.372512:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:991926de-96d8-4a83-9572-e38119e78dc2+11:14436:x1875787987925632:12345-192.168.204.18@tcp:37:lfs.0 Request processed in 4820us (4994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891071.372526:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:1.0:1788891071.375796:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.375955:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987925888 00000100:00100000:2.0:1788891071.375965:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987925888 00000100:00100000:2.0:1788891071.376101:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:2.0:1788891071.376113:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:991926de-96d8-4a83-9572-e38119e78dc2+11:14436:x1875787987925888:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788891071.376359:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:991926de-96d8-4a83-9572-e38119e78dc2+12:14436:x1875787987925888:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 248us (570us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788891071.376366:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:1.0:1788891071.434275:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.434469:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926016 00000100:00100000:3.0:1788891071.434480:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926016 00000100:00100000:3.0:1788891071.434543:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:3.0:1788891071.434552:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+10:14442:x1875787987926016:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:3.0:1788891071.434581:0:15747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891071.434602:0:15747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2170 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434670:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434684:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434696:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434711:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434717:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434723:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434834:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec40378 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434842:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec40378 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434849:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec40378 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891071.434874:0:15747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788891071.434878:0:15747:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788891071.434910:0:15747:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec40378 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434921:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434926:0:15747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434933:0:15747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434938:0:15747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.434942:0:15747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434949:0:15747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434959:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788891071.434967:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.434973:0:15747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434978:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec4036a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434991:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.434996:0:15747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.435001:0:15747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.435006:0:15747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edc600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.435208:0:15747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.435217:0:15747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.435225:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9da1d35feb00) 00010000:00010000:3.0:1788891071.435228:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.435230:0:15747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.435236:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40371 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.435270:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2170 expref: 12 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.435297:0:15747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc200/0x9161b78f8ec40378 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2170 expref: 11 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.435303:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9da1d35fe900) 00010000:00010000:3.0:1788891071.435306:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788891071.435308:0:15747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc200, rc 0) 00000100:00100000:3.0:1788891071.435405:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+11:14442:x1875787987926016:12345-192.168.204.18@tcp:101:bash.0 Request processed in 854us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.435412:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 27 00000100:00100000:3.0:1788891071.440330:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.440429:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926272 00000100:00100000:2.0:1788891071.440499:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926272 00000100:00100000:2.0:1788891071.440556:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 28 00000100:00100000:2.0:1788891071.440675:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+11:14442:x1875787987926272:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788891071.440696:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891071.440717:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec4037f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2177 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.440846:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.440861:0:14336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2169 expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.440870:0:14336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.440919:0:14336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2169 expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.440932:0:14336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2169 expref: 11 pid: 14338 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891071.440945:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14336:1875787996293760:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788891071.441037:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788891071.446393:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14336:1875787996293760:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788891071.446428:0:14336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891071.449029:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891071.449455:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926400 00000100:00100000:1.0:1788891071.449466:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926400 00010000:00010000:1.0:1788891071.449508:0:14321:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2169 expref: 12 pid: 14338 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891071.449553:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:1.0:1788891071.449571:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:991926de-96d8-4a83-9572-e38119e78dc2+12:2374:x1875787987926400:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788891071.449587:0:14321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891071.449594:0:14321:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2169 expref: 12 pid: 14338 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891071.449607:0:14321:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2169 expref: 12 pid: 14338 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891071.449629:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edca00/0x9161b78f8ec4035c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2169 expref: 12 pid: 14338 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891071.449677:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9da1d35fe900) 00010000:00010000:1.0:1788891071.449683:0:14321:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891071.449692:0:14321:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891071.449698:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891071.449733:0:14321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788891071.449795:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:991926de-96d8-4a83-9572-e38119e78dc2+11:2374:x1875787987926400:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 224us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891071.449811:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00010000:00010000:3.0:1788891071.449940:0:14336:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.449948:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.449970:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.449979:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.449987:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450689:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450714:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450721:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891071.450733:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788891071.450766:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450774:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450781:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450802:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f9bba600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.450808:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450816:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450826:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9da1d35fe900) 00010000:00010000:3.0:1788891071.450828:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.450833:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450839:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba600/0x9161b78f8ec40386 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788891071.450851:0:14336:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000116c8857 reply state 000000002fa87417 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891071.450867:0:14336:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788891071.450902:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba800/0x9161b78f8ec4037f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2177 expref: 14 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450916:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2177 expref: 13 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.450924:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891071.450926:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788891071.450928:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc600, rc 0) 00000100:00100000:3.0:1788891071.450971:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+14:14442:x1875787987926272:12345-192.168.204.18@tcp:101:bash.0 Request processed in 10300us (10651us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788891071.450978:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 28 00010000:00010000:3.0:1788891071.458099:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.458120:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.458128:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.458134:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edda00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.458139:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.458146:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.458216:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9da1d35feb00) 00010000:00010000:3.0:1788891071.458219:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.458225:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.458231:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4038d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891071.466361:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.466690:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926528 00000100:00100000:2.0:1788891071.466701:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926528 00000100:00100000:2.0:1788891071.466817:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 29 00000100:00100000:2.0:1788891071.466828:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+13:14442:x1875787987926528:12345-192.168.204.18@tcp:101:bash.0 00010000:00010000:2.0:1788891071.466851:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891071.466873:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a217e expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.467338:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.467355:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.467367:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891071.467432:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788891071.467449:0:14337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788891071.468232:0:14337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.468247:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.468279:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a217e expref: 15 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.468299:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a217e expref: 14 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.468308:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:2.0:1788891071.468310:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788891071.468314:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f9bbac00, rc 0) 00000100:00100000:2.0:1788891071.468414:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+14:14442:x1875787987926528:12345-192.168.204.18@tcp:101:bash.0 Request processed in 1586us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891071.468423:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 29 00000100:00100000:1.0:1788891071.473611:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.473744:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987926784 00000100:00100000:2.0:1788891071.473754:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987926784 00000100:00100000:2.0:1788891071.473845:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:2.0:1788891071.473855:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdb24183-3512-436a-9819-5b2ea51da239+14:14442:x1875787987926784:12345-192.168.204.18@tcp:35:bash.0 00000100:00100000:2.0:1788891071.474318:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdb24183-3512-436a-9819-5b2ea51da239+15:14442:x1875787987926784:12345-192.168.204.18@tcp:35:bash.0 Request processed in 463us (714us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788891071.474326:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:0.0:1788891071.551968:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.552046:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927040 00000100:00100000:3.0:1788891071.552057:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927040 00000100:00100000:3.0:1788891071.552122:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 30 00000100:00100000:3.0:1788891071.552133:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+15:14452:x1875787987927040:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788891071.552156:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891071.552211:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2185 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891071.552386:0:14338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788891071.552508:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2185 expref: 17 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.552524:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9da1c2aee500) 00010000:00010000:3.0:1788891071.552527:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788891071.552533:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2185 expref: 17 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.552547:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edda00, rc 0) 00000100:00100000:3.0:1788891071.552624:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+16:14452:x1875787987927040:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 491us (664us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788891071.552631:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 30 00000100:00100000:1.0:1788891071.556387:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.556796:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927296 00000100:00100000:3.0:1788891071.556806:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927296 00000100:00100000:3.0:1788891071.556931:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:3.0:1788891071.556943:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdb24183-3512-436a-9819-5b2ea51da239+16:14452:x1875787987927296:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:3.0:1788891071.557239:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdb24183-3512-436a-9819-5b2ea51da239+17:14452:x1875787987927296:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 297us (861us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788891071.557247:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:1.0:1788891071.589873:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.589974:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927552 00000100:00100000:3.0:1788891071.589983:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927552 00000100:00100000:3.0:1788891071.590047:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 31 00000100:00100000:3.0:1788891071.590068:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+17:14455:x1875787987927552:12345-192.168.204.18@tcp:101:lfs.0 00010000:00010000:3.0:1788891071.590094:0:15747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891071.590116:0:15747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a218c expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.590249:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec403c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.590263:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec403c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.590276:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec403c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891071.590287:0:15747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788891071.590434:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a218c expref: 20 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.590454:0:15747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec403c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a218c expref: 19 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.590463:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891071.590466:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891071.590469:0:15747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edd400, rc 0) 00000100:00100000:3.0:1788891071.590531:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+19:14455:x1875787987927552:12345-192.168.204.18@tcp:101:lfs.0 Request processed in 475us (734us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788891071.590538:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 31 00000100:00100000:0.0:1788891071.593264:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891071.593312:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.593396:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927808 00000100:00100000:3.0:1788891071.593405:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927808 00000100:00100000:3.0:1788891071.593453:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:3.0:1788891071.593462:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdb24183-3512-436a-9819-5b2ea51da239+19:2375:x1875787987927808:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891071.593475:0:16446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891071.593497:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec403c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a218c expref: 19 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.593515:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891071.593519:0:16446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891071.593910:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdb24183-3512-436a-9819-5b2ea51da239+18:2375:x1875787987927808:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 447us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.593918:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:2.0:1788891071.594327:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987927680 00000100:00100000:2.0:1788891071.594334:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987927680 00000100:00100000:2.0:1788891071.594372:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 32 00000100:00100000:2.0:1788891071.594381:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+18:14455:x1875787987927680:12345-192.168.204.18@tcp:54:lfs.0 00010000:00010000:2.0:1788891071.594440:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.594455:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.594467:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.594494:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.594502:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.594510:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.594517:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f9bbb600 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891071.594522:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.594531:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.594541:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:2.0:1788891071.594545:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788891071.594563:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.594568:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891071.594696:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+18:14455:x1875787987927680:12345-192.168.204.18@tcp:54:lfs.0 Request processed in 315us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891071.594704:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 32 00000100:00100000:0.0:1788891071.599783:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.600001:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928064 00000100:00100000:2.0:1788891071.600012:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928064 00000100:00100000:2.0:1788891071.600075:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:2.0:1788891071.600084:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdb24183-3512-436a-9819-5b2ea51da239+18:14455:x1875787987928064:12345-192.168.204.18@tcp:35:lfs.0 00000100:00100000:2.0:1788891071.600336:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdb24183-3512-436a-9819-5b2ea51da239+19:14455:x1875787987928064:12345-192.168.204.18@tcp:35:lfs.0 Request processed in 253us (564us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788891071.600343:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:1.0:1788891071.814056:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.814163:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928320 00000100:00100000:3.0:1788891071.814218:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928320 00000100:00100000:3.0:1788891071.814292:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:3.0:1788891071.814302:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+19:14486:x1875787987928320:12345-192.168.204.18@tcp:101:cat.0 00010000:00010000:3.0:1788891071.814327:0:15747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891071.814348:0:15747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec403da lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a2193 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.814443:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.814458:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.814470:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788891071.814481:0:15747:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788891071.814651:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edd400/0x9161b78f8ec403da lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2193 expref: 22 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.814670:0:15747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2193 expref: 21 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.814887:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891071.814891:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788891071.814895:0:15747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edda00, rc 0) 00000100:00100000:3.0:1788891071.814962:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+21:14486:x1875787987928320:12345-192.168.204.18@tcp:101:cat.0 Request processed in 661us (916us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788891071.814969:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 33 00000100:00100000:1.0:1788891071.819150:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891071.819242:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.819377:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928704 00000100:00100000:2.0:1788891071.819387:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928704 00000100:00100000:2.0:1788891071.819445:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:2.0:1788891071.819455:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdb24183-3512-436a-9819-5b2ea51da239+21:14486:x1875787987928704:12345-192.168.204.18@tcp:35:cat.0 00000100:00100000:2.0:1788891071.819942:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdb24183-3512-436a-9819-5b2ea51da239+22:14486:x1875787987928704:12345-192.168.204.18@tcp:35:cat.0 Request processed in 487us (698us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788891071.819951:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 8 00000100:00100000:3.0:1788891071.820024:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928448 00000100:00100000:3.0:1788891071.820040:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928448 00000100:00100000:3.0:1788891071.820079:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:3.0:1788891071.820086:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdb24183-3512-436a-9819-5b2ea51da239+22:2375:x1875787987928448:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891071.820095:0:14321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891071.820117:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec403e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2193 expref: 22 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.820134:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891071.820138:0:14321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891071.820160:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdb24183-3512-436a-9819-5b2ea51da239+21:2375:x1875787987928448:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 75us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.820183:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:0.0:1788891071.865626:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.865739:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987928960 00000100:00100000:2.0:1788891071.865748:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987928960 00000100:00100000:2.0:1788891071.865811:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00100000:2.0:1788891071.865820:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+21:14492:x1875787987928960:12345-192.168.204.18@tcp:101:dd.0 00010000:00010000:2.0:1788891071.865860:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891071.865882:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a219a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.865999:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.866214:0:14336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2177 expref: 22 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.866223:0:14336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a217e expref: 22 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.866231:0:14336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.866264:0:14336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a217e expref: 22 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.866278:0:14336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a217e expref: 22 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891071.866291:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14336:1875787996293888:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788891071.866439:0:14336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2177 expref: 22 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.866449:0:14336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2177 expref: 22 pid: 14336 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891071.866471:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c592bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14336:1875787996294016:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788891071.866501:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700540 going to sleep for 11 seconds 00000100:00100000:2.0:1788891071.870241:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14336:1875787996293888:192.168.204.18@tcp:104: 00000100:00100000:2.0:1788891071.870259:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c592bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14336:1875787996294016:192.168.204.18@tcp:104: 00010000:00010000:2.0:1788891071.870287:0:14336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891071.870856:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891071.870894:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.870961:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929088 00000100:00100000:3.0:1788891071.870968:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929088 00010000:00010000:3.0:1788891071.871004:0:16446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a217e expref: 23 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891071.871043:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929216 00000100:00100000:3.0:1788891071.871046:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929216 00010000:00010000:3.0:1788891071.871058:0:16446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2177 expref: 24 pid: 14336 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891071.871084:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:3.0:1788891071.871093:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5686450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdb24183-3512-436a-9819-5b2ea51da239+24:2375:x1875787987929088:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891071.871108:0:16446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891071.871115:0:16446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a217e expref: 24 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871146:0:16446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a217e expref: 24 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871198:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbac00/0x9161b78f8ec403a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a217e expref: 24 pid: 14337 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871215:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891071.871219:0:16446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871228:0:16446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871235:0:16446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891071.871283:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5686450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdb24183-3512-436a-9819-5b2ea51da239+23:2375:x1875787987929088:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 191us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.871290:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:3.0:1788891071.871337:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:3.0:1788891071.871345:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdb24183-3512-436a-9819-5b2ea51da239+22:2375:x1875787987929216:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788891071.871353:0:16446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891071.871359:0:16446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2177 expref: 22 pid: 14336 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871368:0:16446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2177 expref: 22 pid: 14336 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871392:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40394 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a2177 expref: 22 pid: 14336 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871402:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891071.871406:0:16446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871414:0:16446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871421:0:16446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.871440:0:16446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891071.871458:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdb24183-3512-436a-9819-5b2ea51da239+21:2375:x1875787987929216:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 114us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.871464:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 12 00010000:00010000:2.0:1788891071.871688:0:14336:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.871696:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788891071.871716:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788891071.871898:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec403ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a219a expref: 22 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.871914:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb200/0x9161b78f8ec403f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a219a expref: 21 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.871921:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:2.0:1788891071.871924:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788891071.871927:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f9bbb200, rc 0) 00000100:00100000:2.0:1788891071.871952:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+21:14492:x1875787987928960:12345-192.168.204.18@tcp:101:dd.0 Request processed in 6134us (6338us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788891071.871960:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 34 00000100:00100000:0.0:1788891071.875350:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.875468:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929472 00000100:00100000:3.0:1788891071.875479:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929472 00000100:00100000:3.0:1788891071.875579:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 35 00000100:00100000:3.0:1788891071.875589:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+21:14492:x1875787987929472:12345-192.168.204.18@tcp:36:dd.0 00010000:00010000:3.0:1788891071.875865:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.875882:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.875894:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788891071.875977:0:15747:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788891071.876024:0:15747:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008720aab1 reply state 000000004c68d335 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891071.876032:0:15747:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788891071.876126:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+24:14492:x1875787987929472:12345-192.168.204.18@tcp:36:dd.0 Request processed in 538us (786us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788891071.876133:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 35 00000020:00080000:3.0:1788891071.876138:0:15747:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788891071.883079:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.883293:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929600 00000100:00100000:2.0:1788891071.883304:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929600 00000100:00100000:2.0:1788891071.883378:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 36 00000100:00100000:2.0:1788891071.883389:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+24:14492:x1875787987929600:12345-192.168.204.18@tcp:101:dd.0 00010000:00010000:2.0:1788891071.883412:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891071.883434:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec4040b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a21a1 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.883508:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec4040b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a1 expref: 25 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.883523:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec4040b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a1 expref: 25 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.883544:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:2.0:1788891071.883547:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891071.883551:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f9bbb600, rc 0) 00000100:00100000:2.0:1788891071.883611:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+25:14492:x1875787987929600:12345-192.168.204.18@tcp:101:dd.0 Request processed in 224us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891071.883619:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 36 00010000:00010000:3.0:1788891071.886283:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.886303:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.886311:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.886317:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edda00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891071.886322:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.886329:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.886349:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891071.886352:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788891071.886356:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.886362:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec40404 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891071.899135:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891071.899267:0:16446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929856 00000100:00100000:3.0:1788891071.899277:0:16446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929856 00000100:00100000:3.0:1788891071.899374:0:16446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:3.0:1788891071.899384:0:16446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdb24183-3512-436a-9819-5b2ea51da239+24:14492:x1875787987929856:12345-192.168.204.18@tcp:103:dd.0 00010000:00010000:3.0:1788891071.899401:0:16446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788891071.899429:0:16446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb600/0x9161b78f8ec4040b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a1 expref: 24 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891071.899457:0:16446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891071.899463:0:16446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891071.899524:0:16446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdb24183-3512-436a-9819-5b2ea51da239+23:14492:x1875787987929856:12345-192.168.204.18@tcp:103:dd.0 Request processed in 141us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891071.899531:0:16446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:1.0:1788891071.905193:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.905466:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987929984 00000100:00100000:2.0:1788891071.905477:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987929984 00000100:00100000:2.0:1788891071.905585:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:2.0:1788891071.905609:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+23:14492:x1875787987929984:12345-192.168.204.18@tcp:58:dd.0 00010000:00010000:2.0:1788891071.905718:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.905735:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.905761:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891071.906107:0:14337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788891071.906201:0:14337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788891071.906276:0:14337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788891071.906382:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+23:14492:x1875787987929984:12345-192.168.204.18@tcp:58:dd.0 Request processed in 786us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891071.906391:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 37 00000100:00100000:1.0:1788891071.909378:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891071.909741:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930112 00000100:00100000:2.0:1788891071.909751:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930112 00000100:00100000:2.0:1788891071.909808:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 38 00000100:00100000:2.0:1788891071.909818:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+23:14492:x1875787987930112:12345-192.168.204.18@tcp:101:dd.0 00010000:00010000:2.0:1788891071.909836:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788891071.909854:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba400/0x9161b78f8ec40419 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a21a8 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.909907:0:14338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.909917:0:14338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba400/0x9161b78f8ec40419 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a8 expref: 24 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.909934:0:14338:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.909946:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba400/0x9161b78f8ec40419 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a8 expref: 24 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.909977:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:2.0:1788891071.909980:0:14338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788891071.909985:0:14338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba400/0x9161b78f8ec40419 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a8 expref: 24 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891071.909992:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f9bba400, rc 0) 00000100:00100000:2.0:1788891071.910056:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+24:14492:x1875787987930112:12345-192.168.204.18@tcp:101:dd.0 Request processed in 240us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891071.910062:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 38 00010000:00010000:2.0:1788891072.054859:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891072.055210:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3280:1875787996294144:0@lo:400:kworker.0 00000100:00100000:0.0:1788891072.055293:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891072.055351:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996294656:0@lo:400:kworker.0 00000100:00100000:0.0:1788891072.055379:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891072.055405:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891072.055427:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996294528:0@lo:400:kworker.0 00000100:00100000:0.0:1788891072.055452:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788891072.055505:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996294656 00000100:00100000:0.0:1788891072.055513:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996294656 00000100:00100000:0.0:1788891072.055560:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996294528 00000100:00100000:0.0:1788891072.055564:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996294528 00000100:00100000:0.0:1788891072.055588:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788891072.055597:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996294656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891072.055661:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788891072.055666:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875787996294656:12345-0@lo:400:kworker.0 Request processed in 68us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891072.055675:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996294528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788891072.055677:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788891072.055716:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1875787996294656:0@lo:400:kworker.0 00000100:00100000:2.0:1788891072.055732:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875787996294528:12345-0@lo:400:kworker.0 Request processed in 60us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.055741:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875787996294528:0@lo:400:kworker.0 00000100:00100000:2.0:1788891072.055742:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788891072.055822:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996294144 00000100:00100000:3.0:1788891072.055827:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996294144 00000100:00100000:3.0:1788891072.055868:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788891072.055875:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:3280:x1875787996294144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891072.055924:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73a29ebe-4d40-4a82-b77a-4b1222504c0e+19:3280:x1875787996294144:12345-0@lo:400:kworker.0 Request processed in 49us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891072.055930:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788891072.055975:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996294272:0@lo:400:kworker.0 00000100:00080000:3.0:1788891072.055983:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891072.055998:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996294400:0@lo:400:kworker.0 00000100:00100000:1.0:1788891072.056011:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891072.056033:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996294784:0@lo:400:kworker.0 00000100:00100000:3.0:1788891072.056040:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891072.056065:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1fa11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996294912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788891072.056070:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891072.056100:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891072.056116:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996294784 00000100:00100000:1.0:1788891072.056121:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996294784 00000100:00080000:1.0:1788891072.056142:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891072.056151:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996294912 00000100:00100000:3.0:1788891072.056156:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996294912 00000100:00080000:1.0:1788891072.056194:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788891072.056208:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788891072.056211:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788891072.056218:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996294784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788891072.056223:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996294912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788891072.056254:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788891072.056289:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996294912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891072.056295:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788891072.056325:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788891072.056341:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1fa11c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996294912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788891072.056372:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996294272 00000100:00100000:3.0:1788891072.056375:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996294400 00000100:00100000:2.0:1788891072.056378:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996294272 00000100:00100000:3.0:1788891072.056386:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996294400 00000100:00100000:3.0:1788891072.056415:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788891072.056417:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73a29ebe-4d40-4a82-b77a-4b1222504c0e:3280:1875787996294144:0@lo:400:kworker.0 00000100:00100000:3.0:1788891072.056424:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996294400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891072.056428:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788891072.056462:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875787996294400:12345-0@lo:400:kworker.0 Request processed in 40us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891072.056469:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788891072.056497:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1875787996294400:0@lo:400:kworker.0 00000100:00100000:1.0:1788891072.056520:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875787996294784:12345-0@lo:400:kworker.0 Request processed in 305us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891072.056529:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788891072.056558:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1875787996294784:0@lo:400:kworker.0 00000100:00080000:3.0:1788891072.056565:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788891072.057457:0:15020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996294272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788891072.057519:0:15020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875787996294272:12345-0@lo:400:kworker.0 Request processed in 1083us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891072.057526:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788891072.057606:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1875787996294272:0@lo:400:kworker.0 00000040:00080000:0.0:1788891072.246809:0:14371:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788891072.246821:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788891072.246859:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788891072.246865:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788891072.246991:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52cbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14371:1875787996295040:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788891072.247520:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788891072.253443:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891072.253567:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930240 00000100:00100000:2.0:1788891072.253577:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930240 00000100:00100000:2.0:1788891072.253744:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:2.0:1788891072.253769:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fdb24183-3512-436a-9819-5b2ea51da239+25:14494:x1875787987930240:12345-192.168.204.18@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788891072.253861:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fdb24183-3512-436a-9819-5b2ea51da239+25:14494:x1875787987930240:12345-192.168.204.18@tcp:900:lhsmtool_posix.0 Request processed in 94us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891072.253869:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:0.0:1788891072.254134:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52cbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14371:1875787996295040:192.168.204.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788891072.263148:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.263372:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930368 00000100:00100000:0.0:1788891072.263397:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930368 00000100:00100000:0.0:1788891072.263469:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:0.0:1788891072.263480:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+24:14494:x1875787987930368:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788891072.263509:0:14337:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788891072.263615:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+24:14494:x1875787987930368:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 136us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.263623:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 39 00000100:00100000:3.0:1788891072.268285:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.268621:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930496 00000100:00100000:0.0:1788891072.268641:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930496 00000100:00100000:0.0:1788891072.268753:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 40 00000100:00100000:0.0:1788891072.268767:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+24:14494:x1875787987930496:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788891072.268838:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.268856:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.268870:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.268939:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.268947:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.268953:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.268977:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269011:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269019:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891072.269055:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788891072.269060:0:14336:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788891072.269072:0:14336:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269082:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269088:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269095:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269101:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788891072.269105:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269112:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269123:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788891072.269126:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891072.269130:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269146:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec40420 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269158:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269165:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269193:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269198:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788891072.269201:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269208:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269215:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9da1c9a55900) 00010000:00010000:0.0:1788891072.269218:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891072.269221:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269227:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40427 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269240:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269246:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269256:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269262:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788891072.269265:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269270:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269277:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:0.0:1788891072.269279:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891072.269282:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.269288:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4042e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891072.269366:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+24:14494:x1875787987930496:12345-192.168.204.18@tcp:34:lhsmtool_posix.0 Request processed in 603us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.269375:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 40 00000100:00100000:1.0:1788891072.273902:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.274106:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930752 00000100:00100000:0.0:1788891072.274117:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930752 00000100:00100000:0.0:1788891072.274200:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00100000:0.0:1788891072.274210:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+24:14494:x1875787987930752:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891072.274230:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891072.274250:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec40435 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a21af expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274365:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274380:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274392:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891072.274404:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788891072.274512:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274519:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274526:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274532:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788891072.274536:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274543:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274555:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:0.0:1788891072.274557:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788891072.274562:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274578:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec4043c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274622:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec40435 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21af expref: 26 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274643:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9da1c2aee400) 00010000:00010000:0.0:1788891072.274645:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788891072.274649:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec40435 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21af expref: 26 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.274660:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1ffc05c00, rc 0) 00000100:00100000:0.0:1788891072.274726:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+25:14494:x1875787987930752:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 518us (834us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788891072.274733:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 41 00000100:00100000:2.0:1788891072.280065:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891072.280136:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987930880 00000100:00100000:1.0:1788891072.280149:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987930880 00000100:00100000:1.0:1788891072.280361:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 42 00000100:00100000:1.0:1788891072.280371:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+25:14494:x1875787987930880:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788891072.280408:0:14338:0:(mdt_handler.c:7983:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788891072.280515:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+25:14494:x1875787987930880:12345-192.168.204.18@tcp:53:lhsmtool_posix.0 Request processed in 145us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891072.280522:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 42 00000100:00100000:1.0:1788891072.287843:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.288523:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931136 00000100:00100000:0.0:1788891072.288534:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931136 00000100:00100000:0.0:1788891072.288727:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:0.0:1788891072.288739:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+25:14494:x1875787987931136:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891072.288760:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891072.288780:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec4044a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a21b6 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788891072.289720:0:14337:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788891072.289727:0:14337:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788891072.289780:0:14337:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788891072.290054:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40451 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.290076:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40451 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.290089:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40451 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.290151:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec4044a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21b6 expref: 28 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.290228:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40451 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21b6 expref: 27 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.290238:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1c9a55900) 00010000:00010000:0.0:1788891072.290241:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788891072.290245:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1ffc04a00, rc 0) 00000100:00100000:0.0:1788891072.290450:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+27:14494:x1875787987931136:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 1714us (2616us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788891072.290459:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 43 00000100:00100000:2.0:1788891072.293249:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.293358:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931392 00000100:00100000:0.0:1788891072.293368:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931392 00000100:00100000:0.0:1788891072.293473:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 44 00000100:00100000:0.0:1788891072.293484:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+27:14494:x1875787987931392:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788891072.293538:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891072.293563:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40451 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21b6 expref: 27 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293580:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1c9a55900) 00010000:00010000:0.0:1788891072.293602:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788891072.293623:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293647:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293658:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293671:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293678:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293684:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293741:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293748:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293754:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293759:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788891072.293763:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293771:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293785:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9da1d35fe900) 00010000:00010000:0.0:1788891072.293799:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891072.293803:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293809:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec4045f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293818:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293823:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293827:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293832:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05a00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788891072.293835:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293840:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293845:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4e27063d (ffff9da1c9a55500) 00010000:00010000:0.0:1788891072.293847:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891072.293850:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.293854:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40466 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4e27063d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891072.293940:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+26:14494:x1875787987931392:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 458us (698us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788891072.293947:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 44 00000100:00100000:2.0:1788891072.295670:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.295736:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931520 00000100:00100000:3.0:1788891072.295742:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931520 00000100:00100000:3.0:1788891072.295785:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:3.0:1788891072.295796:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+26:14494:x1875787987931520:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788891072.295813:0:15747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788891072.295833:0:15747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4046d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a21bd expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.295880:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40474 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.295892:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.295902:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.296015:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edda00/0x9161b78f8ec4046d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21bd expref: 28 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.296029:0:15747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f4edc600/0x9161b78f8ec40474 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21bd expref: 27 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.296035:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1d35feb00) 00010000:00010000:3.0:1788891072.296037:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788891072.296040:0:15747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1f4edc600, rc 0) 00000100:00100000:3.0:1788891072.296136:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+27:14494:x1875787987931520:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 342us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891072.296142:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 45 00000100:00100000:1.0:1788891072.299406:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891072.299493:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931776 00000100:00100000:2.0:1788891072.299502:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931776 00000100:00100000:2.0:1788891072.299559:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 46 00000100:00100000:2.0:1788891072.299570:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+27:14494:x1875787987931776:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788891072.299678:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.299707:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.299718:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788891072.300130:0:14338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788891072.300141:0:14338:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 296148971904ns, next at 297148969452ns, rc = 0 00000004:00010000:2.0:1788891072.300447:0:14338:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce4a9d0f reply state 000000000587452e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891072.300457:0:14338:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788891072.300554:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+29:14494:x1875787987931776:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 984us (1156us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788891072.300568:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 46 00010000:00010000:3.0:1788891072.302963:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.302984:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.302991:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.303013:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f9bbb400 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891072.303018:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.303026:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.303044:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1d35feb00) 00010000:00010000:3.0:1788891072.303047:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788891072.303052:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.303059:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb400/0x9161b78f8ec4047b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891072.304941:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.305154:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987931904 00000100:00100000:0.0:1788891072.305164:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987931904 00000100:00100000:0.0:1788891072.305641:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:0.0:1788891072.305652:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+28:14494:x1875787987931904:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891072.305675:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891072.305696:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a21c4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.305757:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21c4 expref: 29 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.305772:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21c4 expref: 29 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.305907:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1d35feb00) 00010000:00010000:0.0:1788891072.305911:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788891072.305915:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1ffc05a00, rc 0) 00000100:00100000:0.0:1788891072.306289:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+29:14494:x1875787987931904:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 637us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.306306:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 47 00000100:00100000:2.0:1788891072.308747:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.308851:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932032 00000100:00100000:3.0:1788891072.308862:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932032 00000100:00080000:1.0:1788891072.309023:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788891072.309159:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:3.0:1788891072.309203:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+5:2374:x1875787987932032:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788891072.309761:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+6:2374:x1875787987932032:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 592us (1086us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788891072.309769:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:3.0:1788891072.313656:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891072.314360:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932288 00000100:00100000:1.0:1788891072.314371:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932288 00000100:00100000:1.0:1788891072.314489:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:1.0:1788891072.314501:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdb24183-3512-436a-9819-5b2ea51da239+29:14494:x1875787987932288:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788891072.314781:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdb24183-3512-436a-9819-5b2ea51da239+30:14494:x1875787987932288:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 282us (1132us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788891072.314790:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:1.0:1788891072.317541:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.317623:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932544 00000100:00100000:0.0:1788891072.317642:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932544 00000100:00100000:0.0:1788891072.317822:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:0.0:1788891072.317859:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1fa11dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+30:14494:x1875787987932544:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788891072.317985:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1fa11dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+30:14494:x1875787987932544:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 141us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.317993:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 48 00000100:00100000:3.0:1788891072.320305:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.320371:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932672 00000100:00100000:0.0:1788891072.320380:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932672 00000100:00100000:0.0:1788891072.320474:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 49 00000100:00100000:0.0:1788891072.320486:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+30:14494:x1875787987932672:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788891072.320506:0:15747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788891072.320529:0:15747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec40489 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a21cb expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.320602:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40490 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.320617:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.320643:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788891072.320693:0:15747:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788891072.320712:0:15747:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.320739:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec40489 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21cb expref: 32 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.320756:0:15747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40490 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21cb expref: 31 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.320778:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1d35feb00) 00010000:00010000:0.0:1788891072.320781:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788891072.320784:0:15747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1ffc04a00, rc 0) 00000100:00100000:0.0:1788891072.320840:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+31:14494:x1875787987932672:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 357us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.320847:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 49 00000100:00100000:3.0:1788891072.323484:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891072.323580:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987932800 00000100:00100000:1.0:1788891072.323590:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987932800 00000100:00100000:1.0:1788891072.323657:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:1.0:1788891072.323668:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdb24183-3512-436a-9819-5b2ea51da239+6:2374:x1875787987932800:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788891072.323686:0:15021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891072.323707:0:15021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a21d2 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788891072.323733:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa04fc0, blocks: 0x1 00010000:00010000:1.0:1788891072.323751:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1788891072.323756:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891072.323766:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d2 expref: 7 pid: 15021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.323800:0:15021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d2 expref: 7 pid: 15021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.323816:0:15021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6e200, rc 0) 00000100:00100000:1.0:1788891072.323913:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdb24183-3512-436a-9819-5b2ea51da239+7:2374:x1875787987932800:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 247us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891072.323921:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:1.0:1788891072.326339:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891072.326437:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933056 00000100:00100000:2.0:1788891072.326445:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933056 00000100:00100000:2.0:1788891072.326501:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 50 00000100:00100000:2.0:1788891072.326511:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c2cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+31:14494:x1875787987933056:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788891072.326623:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c2cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+31:14494:x1875787987933056:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891072.326645:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 50 00000100:00100000:3.0:1788891072.332355:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891072.332595:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933184 00000100:00100000:2.0:1788891072.332604:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933184 00000100:00100000:2.0:1788891072.332711:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 51 00000100:00100000:2.0:1788891072.332722:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+31:14494:x1875787987933184:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788891072.369241:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1788891072.369283:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788891072.369292:0:5836:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788891072.369477:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788891072.369498:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996295168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788891072.369541:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdb24183-3512-436a-9819-5b2ea51da239+27:14494:x1875787987933184:12345-192.168.204.18@tcp:44:lhsmtool_posix.0 Request processed in 36635us (37009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.369563:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788891072.369723:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 51 00000001:00080000:1.0:1788891072.369823:0:5836:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788891072.370068:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996295168 00000100:00100000:2.0:1788891072.370076:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996295168 00000100:00100000:2.0:1788891072.370117:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788891072.370131:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996295168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788891072.370304:0:15018:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788891072.370307:0:15018:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788891072.370309:0:15018:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788891072.370311:0:15018:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788891072 -> 1788891072 00002000:00010000:2.0:1788891072.370313:0:15018:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788891072.370364:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875787996295168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (801us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788891072.370370:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788891072.370545:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9da1f52cbb80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788891072.370551:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996295168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788891072.376264:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891072.376936:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933312 00000100:00100000:2.0:1788891072.376947:0:15021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933312 00000100:00100000:2.0:1788891072.377012:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:2.0:1788891072.377022:0:15021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c2cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdb24183-3512-436a-9819-5b2ea51da239+7:2375:x1875787987933312:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788891072.377142:0:15021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c2cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdb24183-3512-436a-9819-5b2ea51da239+7:2375:x1875787987933312:12345-192.168.204.18@tcp:16:lhsmtool_posix.0 Request processed in 122us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891072.377150:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 16 00000100:00100000:2.0:1788891072.380687:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891072.380862:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933568 00000100:00100000:1.0:1788891072.380873:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933568 00000100:00100000:1.0:1788891072.380937:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 52 00000100:00100000:1.0:1788891072.380948:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+14:14494:x1875787987933568:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788891072.381002:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788891072.381033:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04a00/0x9161b78f8ec40490 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21cb expref: 14 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.381054:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1d35feb00) 00010000:00010000:1.0:1788891072.381059:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891072.381093:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.381106:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.381115:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788891072.381445:0:14338:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edef1319 reply state 0000000019ec31a6 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891072.381455:0:14338:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788891072.381554:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdb24183-3512-436a-9819-5b2ea51da239+15:14494:x1875787987933568:12345-192.168.204.18@tcp:36:lhsmtool_posix.0 Request processed in 607us (875us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788891072.381574:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 52 00000100:00100000:3.0:1788891072.384040:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00010000:00010000:2.0:1788891072.384113:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.384127:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891072.384148:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933696 00000100:00100000:1.0:1788891072.384158:0:15018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933696 00000100:00100000:1.0:1788891072.384238:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:1.0:1788891072.384254:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdb24183-3512-436a-9819-5b2ea51da239+7:14494:x1875787987933696:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788891072.384259:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.384268:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:2.0:1788891072.384272:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.384281:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.384298:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1d35feb00) 00010000:00010000:2.0:1788891072.384301:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788891072.384307:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.384313:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1d0f6e000/0x9161b78f8ec4049e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.384412:0:15018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788891072.384432:0:15018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x862ec9343e4a21d9 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.384463:0:15018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d2 expref: 8 pid: 15021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.384473:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891072.384477:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891072.384483:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 8 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.384515:0:15018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d2 expref: 8 pid: 15021 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.384529:0:15018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d2 expref: 8 pid: 15021 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891072.384544:0:15018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c2cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15018:1875787996295296:192.168.204.18@tcp:104: 00000100:00100000:1.0:1788891072.385095:0:15018:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c937a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788891072.389758:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891072.389872:0:15018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c2cdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15018:1875787996295296:192.168.204.18@tcp:104: 00010000:00010000:1.0:1788891072.389904:0:15018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 8 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.389926:0:15018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9da1d0f6ec00, rc 0) 00000100:00100000:1.0:1788891072.389986:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdb24183-3512-436a-9819-5b2ea51da239+8:14494:x1875787987933696:12345-192.168.204.18@tcp:101:lhsmtool_posix.0 Request processed in 5734us (5952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891072.390080:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933824 00000100:00100000:2.0:1788891072.390086:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933824 00010000:00010000:2.0:1788891072.390117:0:14323:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d2 expref: 9 pid: 15021 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891072.390226:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:2.0:1788891072.390235:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdb24183-3512-436a-9819-5b2ea51da239+9:2374:x1875787987933824:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788891072.390248:0:14323:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788891072.390267:0:14323:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d2 expref: 9 pid: 15021 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.390280:0:14323:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d2 expref: 9 pid: 15021 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.390303:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000856f20ed/0x9161b78f8ec40497 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d2 expref: 9 pid: 15021 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.390317:0:14323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891072.390321:0:14323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891072.390327:0:14323:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 8 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.390337:0:14323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 8 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.390383:0:14323:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 8 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891072.390396:0:14323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5929f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14323:1875787996295424:192.168.204.18@tcp:105: 00000100:00100000:2.0:1788891072.390441:0:14323:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c5700900 going to sleep for 11 seconds 00000100:00100000:1.0:1788891072.390489:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 17 00000100:00100000:3.0:1788891072.393615:0:14323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5929f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14323:1875787996295424:192.168.204.18@tcp:105: 00010000:00010000:3.0:1788891072.393655:0:14323:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788891072.393776:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdb24183-3512-436a-9819-5b2ea51da239+7:2374:x1875787987933824:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 3541us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891072.393787:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 13 00000100:00100000:1.0:1788891072.393945:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.394059:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987933952 00000100:00100000:3.0:1788891072.394066:0:15020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987933952 00000100:00100000:3.0:1788891072.394112:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:3.0:1788891072.394121:0:15020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c2cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdb24183-3512-436a-9819-5b2ea51da239+7:2374:x1875787987933952:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788891072.394474:0:15020:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788891072.394478:0:15020:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788891072 00002000:00010000:3.0:1788891072.394480:0:15020:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788891071 00002000:00010000:3.0:1788891072.394482:0:15020:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788891072 -> 1788891072 00002000:00010000:3.0:1788891072.394485:0:15020:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788891072.394559:0:15020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c2cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdb24183-3512-436a-9819-5b2ea51da239+8:2374:x1875787987933952:12345-192.168.204.18@tcp:2:lhsmtool_posix.0 Request processed in 438us (615us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788891072.394567:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:1.0:1788891072.397114:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.397791:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934080 00000100:00100000:3.0:1788891072.397805:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934080 00000100:00100000:3.0:1788891072.397864:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:3.0:1788891072.397875:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c2cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+8:2372:x1875787987934080:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788891072.397920:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.397953:0:15104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 8 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.397962:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891072.397967:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788891072.397971:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.398077:0:15104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 8 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.398093:0:15104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 8 pid: 15018 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891072.398107:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1d0f21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15104:1875787996295552:192.168.204.18@tcp:104: 00000100:00100000:3.0:1788891072.398361:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c8518300 going to sleep for 11 seconds 00000100:00100000:3.0:1788891072.400934:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1d0f21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15104:1875787996295552:192.168.204.18@tcp:104: 00010000:00010000:3.0:1788891072.400965:0:15104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891072.404751:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.404882:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934208 00000100:00100000:0.0:1788891072.404893:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934208 00010000:00010000:0.0:1788891072.404933:0:14321:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 9 pid: 15018 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891072.404978:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 14 00000100:00100000:0.0:1788891072.404987:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c2cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdb24183-3512-436a-9819-5b2ea51da239+9:2374:x1875787987934208:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891072.405023:0:14321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891072.405046:0:14321:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 9 pid: 15018 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.405060:0:14321:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 9 pid: 15018 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.405108:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066fb3974/0x9161b78f8ec404a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21d9 expref: 9 pid: 15018 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.405128:0:14321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891072.405133:0:14321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788891072.405139:0:14321:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.405150:0:14321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.405226:0:14321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788891072.405262:0:15104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.405272:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891072.405287:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c2cde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdb24183-3512-436a-9819-5b2ea51da239+8:2374:x1875787987934208:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 300us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.405294:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 14 00010000:00010000:3.0:1788891072.405311:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.405319:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.405328:0:15104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.405335:0:15104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edda00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891072.405340:0:15104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.405349:0:15104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.405361:0:15104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.405373:0:15104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891072.405420:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c2cdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+7:2372:x1875787987934080:12345-192.168.204.18@tcp:1:lhsmtool_posix.0 Request processed in 7547us (8314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891072.405437:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:2.0:1788891072.407427:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.407590:0:15747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934464 00000100:00100000:0.0:1788891072.407599:0:15747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934464 00000100:00100000:0.0:1788891072.407664:0:15747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 53 00000100:00100000:0.0:1788891072.407674:0:15747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+14:14494:x1875787987934464:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788891072.407759:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.407777:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.407790:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.408050:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.408062:0:15747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21c4 expref: 15 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.408070:0:15747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.408103:0:15747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21c4 expref: 15 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.408117:0:15747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21c4 expref: 15 pid: 14337 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891072.408131:0:15747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1f52c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15747:1875787996295680:192.168.204.18@tcp:104: 00000100:00100000:0.0:1788891072.408437:0:15747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c92fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788891072.410962:0:15747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1f52c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15747:1875787996295680:192.168.204.18@tcp:104: 00010000:00010000:0.0:1788891072.411049:0:15747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891072.411795:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.411988:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934592 00000100:00100000:0.0:1788891072.411997:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934592 00010000:00010000:0.0:1788891072.412037:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21c4 expref: 16 pid: 14337 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891072.412115:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 15 00000100:00100000:0.0:1788891072.412146:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdb24183-3512-436a-9819-5b2ea51da239+16:2374:x1875787987934592:12345-192.168.204.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788891072.412163:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788891072.412206:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21c4 expref: 16 pid: 14337 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.412219:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21c4 expref: 16 pid: 14337 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.412242:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05a00/0x9161b78f8ec40482 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21c4 expref: 16 pid: 14337 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.412260:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1d35feb00) 00010000:00010000:0.0:1788891072.412265:0:14322:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.412275:0:14322:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.412283:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.412316:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788891072.412346:0:15747:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.412357:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891072.412580:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdb24183-3512-436a-9819-5b2ea51da239+15:2374:x1875787987934592:12345-192.168.204.18@tcp:103:ldlm_bl.0 Request processed in 434us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.412588:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 15 00000001:00080000:1.0:1788891072.413435:0:15747:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788891072.413612:0:15747:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788891072.413675:0:15747:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788891072.413775:0:15747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da0c2cdea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15747:1875787996295808:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788891072.413886:0:15747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891072.413922:0:15747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c937ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891072.413964:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996295808 00000100:00100000:0.0:1788891072.413971:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996295808 00000100:00100000:0.0:1788891072.414088:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788891072.414097:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da0c2cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15747:x1875787996295808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788891072.414298:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da0c2cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15747:x1875787996295808:12345-0@lo:1000:mdt00_003.0 Request processed in 202us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891072.414306:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788891072.414675:0:15747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da0c2cdea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15747:1875787996295808:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788891072.416221:0:15747:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788891072.416303:0:15747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15747:1875787996295936:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788891072.416356:0:15747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788891072.416406:0:15747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c937a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788891072.416642:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996295936 00000100:00100000:1.0:1788891072.416649:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996295936 00000100:00100000:1.0:1788891072.416702:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788891072.416711:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c5928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15747:x1875787996295936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788891072.416902:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15747:x1875787996295936:12345-0@lo:1000:mdt00_003.0 Request processed in 192us (544us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788891072.416918:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788891072.416952:0:15747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5928e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15747:1875787996295936:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788891072.416991:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417002:0:15747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417027:0:15747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417033:0:15747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05c00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891072.417038:0:15747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417046:0:15747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417061:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1d35feb00) 00010000:00010000:3.0:1788891072.417065:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788891072.417070:0:15747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417076:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05c00/0x9161b78f8ec404ba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417113:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417120:0:15747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417133:0:15747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417139:0:15747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f9bbb000 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:3.0:1788891072.417143:0:15747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417150:0:15747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417159:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:3.0:1788891072.417162:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788891072.417194:0:15747:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba400/0x9161b78f8ec40419 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a8 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417206:0:15747:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba400/0x9161b78f8ec40419 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a8 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.417216:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba400/0x9161b78f8ec40419 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a8 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.417301:0:15747:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bba400/0x9161b78f8ec40419 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.18@tcp remote: 0x862ec9343e4a21a8 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891072.417315:0:15747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da1c5929880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15747:1875787996296064:192.168.204.18@tcp:105: 00000100:00100000:2.0:1788891072.417544:0:15747:0:(client.c:2715:ptlrpc_set_wait()) set ffff9da1c937ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788891072.422265:0:15747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da1c5929880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15747:1875787996296064:192.168.204.18@tcp:105: 00010000:00010000:0.0:1788891072.422297:0:15747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422308:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb000/0x9161b78f8ec40412 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422343:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422356:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422367:0:15747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422379:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422386:0:15747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422393:0:15747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422399:0:15747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc04e00 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788891072.422403:0:15747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422427:0:15747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422440:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:0.0:1788891072.422443:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788891072.422447:0:15747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422453:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc04e00/0x9161b78f8ec404c1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422473:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422479:0:15747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422486:0:15747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422490:0:15747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1ffc05200 already unused, calling callback (ffffffffc21fa4f0) 00010000:00010000:0.0:1788891072.422493:0:15747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422499:0:15747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422506:0:15747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9da1d35fe500) 00010000:00010000:0.0:1788891072.422508:0:15747:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788891072.422511:0:15747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788891072.422526:0:15747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1ffc05200/0x9161b78f8ec404b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15747 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788891072.422803:0:15747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c5928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdb24183-3512-436a-9819-5b2ea51da239+18:14494:x1875787987934464:12345-192.168.204.18@tcp:57:lhsmtool_posix.0 Request processed in 15127us (15381us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788891072.422813:0:15747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 53 00000020:00080000:0.0:1788891072.422819:0:15747:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788891072.422895:0:14371:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788891072.422900:0:14371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788891072.422949:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788891072.422956:0:14371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788891072.423932:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:2.0:1788891072.423985:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934720 00000100:00100000:2.0:1788891072.423997:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934720 00000100:00100000:2.0:1788891072.424086:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:2.0:1788891072.424097:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4cd4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdb24183-3512-436a-9819-5b2ea51da239+18:14492:x1875787987934720:12345-192.168.204.18@tcp:49:dd.0 00000100:00100000:2.0:1788891072.424236:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4cd4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdb24183-3512-436a-9819-5b2ea51da239+18:14492:x1875787987934720:12345-192.168.204.18@tcp:49:dd.0 Request processed in 141us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788891072.424255:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:2.0:1788891072.426418:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.426468:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987934976 00000100:00100000:3.0:1788891072.426477:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987934976 00000100:00100000:3.0:1788891072.426531:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:3.0:1788891072.426541:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c592b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdb24183-3512-436a-9819-5b2ea51da239+18:14494:x1875787987934976:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788891072.427391:0:14340:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788891072.427509:0:14340:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788891072.427550:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.427578:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.427589:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.427598:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.427605:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.427611:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.427641:0:14340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788891072.427721:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c592b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdb24183-3512-436a-9819-5b2ea51da239+20:14494:x1875787987934976:12345-192.168.204.18@tcp:35:lhsmtool_posix.0 Request processed in 1181us (1315us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788891072.427733:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 11 00000020:00080000:2.0:1788891072.427738:0:14340:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788891072.427802:0:14325:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788891072.427809:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.427816:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f9bbb800 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788891072.427821:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.427829:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.427841:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9da1d35feb00) 00010000:00010000:1.0:1788891072.427844:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788891072.427848:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.427854:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9da1f9bbb800/0x9161b78f8ec404c8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.427864:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891072.427865:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788891072.427867:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891072.548226:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891072.548321:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935104 00000100:00100000:1.0:1788891072.548333:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935104 00000100:00100000:1.0:1788891072.548397:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:1.0:1788891072.548407:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdb24183-3512-436a-9819-5b2ea51da239+7:2375:x1875787987935104:12345-192.168.204.18@tcp:4:dd.0 00002000:00010000:1.0:1788891072.548479:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa04fc0, atime: 0x6aa04fbf, ctime: 0x6aa04fc0, blocks: 0x1 00010000:00010000:1.0:1788891072.548489:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.548507:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1788891072.548512:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891072.548518:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.548531:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891072.550573:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.550639:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.550668:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.550682:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.550698:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.550781:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788891072.550790:0:15025:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788891072.552085:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891072.552111:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891072.552954:0:15025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935232 00000100:00100000:0.0:1788891072.552964:0:15025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935232 00000100:00100000:0.0:1788891072.553036:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788891072.553044:0:15025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935360 00000100:00100000:0.0:1788891072.553047:0:15025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935360 00000100:00100000:0.0:1788891072.553063:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788891072.553069:0:15025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935488 00000100:00100000:0.0:1788891072.553072:0:15025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935488 00000100:00100000:0.0:1788891072.553083:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788891072.553093:0:15025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935616 00000100:00100000:0.0:1788891072.553096:0:15025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935616 00000100:00100000:0.0:1788891072.553109:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788891072.553114:0:15025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935744 00000100:00100000:0.0:1788891072.553116:0:15025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935744 00000100:00100000:0.0:1788891072.553128:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788891072.553133:0:15025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936000 00000100:00100000:0.0:1788891072.553135:0:15025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936000 00000100:00100000:0.0:1788891072.553145:0:15025:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788891072.553151:0:15025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987935872 00000100:00100000:0.0:1788891072.553154:0:15025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987935872 00000100:00100000:3.0:1788891072.553688:0:16558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:3.0:1788891072.553699:0:16558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdb24183-3512-436a-9819-5b2ea51da239+15:2374:x1875787987935232:12345-192.168.204.18@tcp:4:dd.0 00010000:00010000:3.0:1788891072.553738:0:16558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.553758:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891072.553763:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891072.553769:0:16558:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.553859:0:16558:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788891072.621997:0:16558:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1788891072.622007:0:16558:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1788891072.622022:0:16558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.622049:0:16558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.622059:0:16558:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.622067:0:16558:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edda00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891072.622073:0:16558:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.622082:0:16558:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.622253:0:16558:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.622263:0:16558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b9f0fc7/0x9161b78f8ec404d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891072.622352:0:16558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdb24183-3512-436a-9819-5b2ea51da239+19:2374:x1875787987935232:12345-192.168.204.18@tcp:4:dd.0 Request processed in 68650us (71781us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788891072.622368:0:16558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 1 00000100:00100000:2.0:1788891072.622400:0:16558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:2.0:1788891072.622412:0:16558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdb24183-3512-436a-9819-5b2ea51da239+18:2374:x1875787987935360:12345-192.168.204.18@tcp:4:dd.0 00010000:00010000:2.0:1788891072.622441:0:16558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.622458:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891072.622462:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891072.622468:0:16558:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.622480:0:16558:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891072.622668:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1788891072.622682:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1788891072.622688:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00010000:00010000:3.0:1788891072.622961:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.622974:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.622983:0:15024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.623002:0:15024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6e400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891072.623006:0:15024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.623015:0:15024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.623028:0:15024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.623035:0:15024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d6b05d3/0x9161b78f8ec404cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891072.623086:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdb24183-3512-436a-9819-5b2ea51da239+12:2375:x1875787987935104:12345-192.168.204.18@tcp:4:dd.0 Request processed in 74679us (74924us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788891072.623094:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 0 00000100:00100000:3.0:1788891072.623115:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:3.0:1788891072.623123:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdb24183-3512-436a-9819-5b2ea51da239+11:2374:x1875787987935488:12345-192.168.204.18@tcp:4:dd.0 00010000:00010000:3.0:1788891072.623154:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.623164:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891072.623196:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891072.623202:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.623225:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788891072.674346:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1788891072.674988:0:16558:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:3.0:1788891072.674994:0:16558:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788891072.675010:0:16558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.675024:0:16558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.675033:0:16558:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.675040:0:16558:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f9bba000 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891072.675045:0:16558:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.675053:0:16558:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.675073:0:16558:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.675081:0:16558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3d9db0f/0x9161b78f8ec404dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891072.675216:0:16558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdb24183-3512-436a-9819-5b2ea51da239+13:2374:x1875787987935360:12345-192.168.204.18@tcp:4:dd.0 Request processed in 52803us (124572us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788891072.675228:0:16558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 2 00000100:00100000:3.0:1788891072.675262:0:16558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:3.0:1788891072.675276:0:16558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdb24183-3512-436a-9819-5b2ea51da239+12:2374:x1875787987935616:12345-192.168.204.18@tcp:4:dd.0 00010000:00010000:3.0:1788891072.675308:0:16558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.675321:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891072.675326:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891072.675332:0:16558:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.675344:0:16558:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788891072.713934:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1788891072.714002:0:15024:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1788891072.714008:0:15024:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788891072.714023:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.714036:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.714045:0:15024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.714068:0:15024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd400 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891072.714073:0:15024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.714083:0:15024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.714105:0:15024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.714114:0:15024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047612594/0x9161b78f8ec404e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891072.714239:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdb24183-3512-436a-9819-5b2ea51da239+12:2374:x1875787987935488:12345-192.168.204.18@tcp:4:dd.0 Request processed in 91111us (163564us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788891072.714250:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 3 00000100:00100000:3.0:1788891072.714282:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:2.0:1788891072.716809:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdb24183-3512-436a-9819-5b2ea51da239+11:2374:x1875787987935744:12345-192.168.204.18@tcp:4:dd.0 00010000:00010000:2.0:1788891072.716856:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.716875:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891072.716880:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788891072.716885:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.716899:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788891072.745721:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:3.0:1788891072.745910:0:16558:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1788891072.745916:0:16558:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1788891072.745930:0:16558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.745943:0:16558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.745969:0:16558:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.745979:0:16558:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4eddc00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:3.0:1788891072.745984:0:16558:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.745993:0:16558:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.746015:0:16558:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.746034:0:16558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe95d618/0x9161b78f8ec404eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788891072.746158:0:16558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdb24183-3512-436a-9819-5b2ea51da239+11:2374:x1875787987935616:12345-192.168.204.18@tcp:4:dd.0 Request processed in 70883us (195469us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788891072.746212:0:16558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 4 00000100:00100000:3.0:1788891072.746248:0:16558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 6 00000100:00100000:3.0:1788891072.746263:0:16558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdb24183-3512-436a-9819-5b2ea51da239+10:2375:x1875787987936000:12345-192.168.204.18@tcp:4:dd.0 00010000:00010000:3.0:1788891072.746554:0:16558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.747254:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891072.747270:0:16558:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788891072.747276:0:16558:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788891072.747292:0:16558:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891072.795064:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:1.0:1788891072.797308:0:15024:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1788891072.797319:0:15024:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:1.0:1788891072.797334:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.797347:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.797357:0:15024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.797378:0:15024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f9bba600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788891072.797383:0:15024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.797394:0:15024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.797415:0:15024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.797424:0:15024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0389271/0x9161b78f8ec404f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891072.797519:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdb24183-3512-436a-9819-5b2ea51da239+10:2374:x1875787987935744:12345-192.168.204.18@tcp:4:dd.0 Request processed in 83221us (246814us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788891072.797529:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 5 00000100:00100000:1.0:1788891072.797564:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 7 00000100:00100000:1.0:1788891072.797576:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdb24183-3512-436a-9819-5b2ea51da239+9:2375:x1875787987935872:12345-192.168.204.18@tcp:4:dd.0 00010000:00010000:1.0:1788891072.797607:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.797631:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891072.797636:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788891072.797643:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.797669:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788891072.827762:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00010000:00010000:1.0:1788891072.828246:0:16558:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.828261:0:16558:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.828271:0:16558:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.828278:0:16558:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1f4edd600 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:1.0:1788891072.828284:0:16558:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.828293:0:16558:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.828317:0:16558:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788891072.828324:0:16558:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f64f69/0x9161b78f8ec404f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788891072.828436:0:16558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdb24183-3512-436a-9819-5b2ea51da239+9:2375:x1875787987936000:12345-192.168.204.18@tcp:4:dd.0 Request processed in 82173us (276350us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788891072.828458:0:16558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 6 00000001:00080000:3.0:1788891072.855587:0:6689:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:2.0:1788891072.855792:0:15024:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788891072.855808:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.855841:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.855850:0:15024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.855859:0:15024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9da1d0f6fc00 already unused, calling callback (ffffffffc17ef260) 00010000:00010000:2.0:1788891072.855864:0:15024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.855873:0:15024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.855893:0:15024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788891072.855901:0:15024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000624ae31c/0x9161b78f8ec40500 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788891072.856060:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1d0f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdb24183-3512-436a-9819-5b2ea51da239+5:2375:x1875787987935872:12345-192.168.204.18@tcp:4:dd.0 Request processed in 58482us (303943us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788891072.856071:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 7 00010000:00010000:2.0:1788891073.078595:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788891073.590382:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9da201f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996296192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788891073.590476:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788891073.590618:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787996296192 00000100:00100000:1.0:1788891073.590626:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787996296192 00000100:00100000:1.0:1788891073.590681:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788891073.590691:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f52c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996296192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788891073.590715:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1788891073.594508:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f52c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875787996296192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3809us (4022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891073.594521:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788891073.594571:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788891073.594578:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9da1f52cbb80, transno 8589934595 00000004:00080000:0.0:1788891073.594593:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788891073.594643:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9da201f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1875787996296192:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788891073.868429:0:16596:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788891074.104398:0:14325:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788891074.794314:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891074.794372:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:0.0:1788891074.794478:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936128 00000100:00100000:0.0:1788891074.794489:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936128 00000100:00100000:0.0:1788891074.794546:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 117 00000100:00100000:0.0:1788891074.794557:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1f4ce9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+13:2372:x1875787987936128:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:0.0:1788891074.794664:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1f4ce9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc193f55-7156-499f-9b02-e138dba3feae+13:2372:x1875787987936128:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 108us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788891074.794672:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 117 00000100:00100000:3.0:1788891074.795217:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891074.795250:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891074.795274:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891074.795289:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:3.0:1788891074.795315:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.18@tcp (source: 12345-192.168.204.18@tcp) 00000100:00100000:1.0:1788891074.795325:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936256 00000100:00100000:1.0:1788891074.795333:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936256 00000100:00100000:3.0:1788891074.795340:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936512 00000100:00100000:3.0:1788891074.795345:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936512 00000100:00100000:1.0:1788891074.795383:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936640 00000100:00100000:1.0:1788891074.795388:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936640 00000100:00100000:3.0:1788891074.795398:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936768 00000100:00100000:3.0:1788891074.795403:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936768 00000100:00100000:1.0:1788891074.795418:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:3.0:1788891074.795425:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936384 00000100:00100000:3.0:1788891074.795430:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936384 00000100:00100000:1.0:1788891074.795431:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+20:2372:x1875787987936256:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788891074.795453:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875787987936896 00000100:00100000:3.0:1788891074.795458:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875787987936896 00000100:00100000:3.0:1788891074.795478:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:1.0:1788891074.795487:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdb24183-3512-436a-9819-5b2ea51da239+20:2372:x1875787987936256:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 59us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891074.795489:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da201f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+5:2373:x1875787987936512:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788891074.795502:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 18 00000100:00100000:1.0:1788891074.795520:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:3.0:1788891074.795530:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da201f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdb24183-3512-436a-9819-5b2ea51da239+5:2373:x1875787987936512:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 43us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891074.795531:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:991926de-96d8-4a83-9572-e38119e78dc2+6:2373:x1875787987936640:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788891074.795543:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 9 00000100:00100000:3.0:1788891074.795562:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:1.0:1788891074.795567:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:991926de-96d8-4a83-9572-e38119e78dc2+6:2373:x1875787987936640:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 40us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788891074.795575:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 19 00000100:00100000:3.0:1788891074.795600:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:2373:x1875787987936768:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788891074.795612:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:1.0:1788891074.795630:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1cafa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdb24183-3512-436a-9819-5b2ea51da239+5:2373:x1875787987936384:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:3.0:1788891074.795633:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:2373:x1875787987936768:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 37us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891074.795642:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 10 00000100:00100000:3.0:1788891074.795659:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.18@tcp, seq: 12 00000100:00100000:1.0:1788891074.795664:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1cafa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdb24183-3512-436a-9819-5b2ea51da239+5:2373:x1875787987936384:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 37us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788891074.795671:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9da1c8bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:2373:x1875787987936896:12345-192.168.204.18@tcp:400:kworker.0 00000100:00100000:1.0:1788891074.795678:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 11 00000100:00100000:3.0:1788891074.795702:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9da1c8bcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:991926de-96d8-4a83-9572-e38119e78dc2+5:2373:x1875787987936896:12345-192.168.204.18@tcp:400:kworker.0 Request processed in 36us (386us total) trans 0 rc 0/0 00000100:00080000:2.0:1788891074.796056:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788891074.796060:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788891074.796063:0:14332:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788891074.796893:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.18@tcp, seq: 12 Debug log: 27960 lines, 27960 kept, 0 dropped, 0 bad.